About

I am a Ph.D. student in the Department of Computer Science at Princeton University, where I work with Prof. Jia Deng in the Princeton Vision & Learning Lab. I am also working closely with Prof. Olga Russakovsky. I am interested in formal reasoning, machine learning, and artificial intelligence in general. My current research focuses on how machine learning techniques can be applied to solve automated theorem proving — a long-standing research area that was dominated by formal methods. Prior to that, I worked on human pose estimation, action detection, and visual relationship understanding.

I received my master’s degree from the University of Michigan and my bachelor’s degree from Tsinghua University.

[杨凯峪] [Email: kaiyuy@cs.princeton.edu] [CV]

News

  • 4/2019 Our paper “Learning to Prove Theorems via Interacting with Proof Assistants” is accepted to ICML 2019. [oral] [poster]

  • 7/2017 Our model scored second (localization) and third (classification) in the Charades Activity Challenge at CVPR 2017.

  • 4/2016 We released the code for stacked hourglass networks – a state-of-the-art model for human pose estimation.

Research

Theorem Proving in Proof Assistants: We use machine learning to automatically prove theorems, including not only theorems in math but also theorems describing the behavior of software and hardware systems. Existing theorem provers usually search for proofs represented at a very low level, such as first-order logic and resolutions. Therefore they lack the high-level reasoning and problem-specific insights common to humans.

In contrast, we use a powerful set of tools called proof assistants (a.k.a. interactive theorem provers). These are software that assists human experts in proving theorems. They thus provide a high-level framework that is close to human mathematical reasoning. Instead of humans, we develop machine learning agents to interact with proof assistants. Our agent can learn from human interactions by imitation learning using a large amount of data available online. We use this data to construct a large-scale dataset for training/evaluating the agent. We also develop a baseline model that can prove many new theorems not provable by existing methods.

Publications

  1. Kaiyu Yang and Jia Deng. “Learning to Prove Theorems via Interacting with Proof Assistants.” International Conference on Machine Learning (ICML). 2019.
    [paper] [code] [slides] [poster]
  2. Kaiyu Yang, Olga Russakovsky, and Jia Deng. “SpatialSense: An Adversarially Crowdsourced Benchmark for Spatial Relation Recognition.” In review.
  3. Alejandro Newell, Kaiyu Yang, and Jia Deng. “Stacked Hourglass Networks for Human Pose Estimation.” European Conference on Computer Vision (ECCV). 2016.
    [paper] [code]

Teaching

  • During my undergraduate years, I served as a TA for Data Structures and Algorithms at Tsinghua University, which was offered to both students on-campus and the general public as a massive open online course (MOOC). I received the Outstanding Teaching Assistant Award twice (in 2015 and 2016). Besides regular TA responsibilities such as grading and office hours, I also dealt with the online infrastructure for MOOC.