Zhengyi (Zen) Luo

Hi there! My name is Zhengyi Luo (Zen) and I am a first year PhD student at Carnegie Mellon University’s Robotics Institute, School of Computer Science, advised by Prof. Kris Kitani. I earned my bachelor’s degree from University of Pennsylvania in 2019, where I worked with Prof. Kostas Daniilidis.

My research interest lies at the intersection of computer vision, machine learning, and robotics. I am working on topcis including human pose estimation, human-object interaction estimation, human motion generation etc. Through my research, I want to create methods that effectively interpret spatial-temporal sensory input and build a compositional representation of the 3D world to reason about the interactions between agents and the physical environment. On the application side, I am excited about building systems that would be useful as assistive robots, autonomous vehicles, and AR/VR virtual assistants.

Pittsburgh PA, 15213

Education

Ph.D. in Robotics
School of Computer Science
Aug 2021-Present

M.S in Robotics
School of Computer Science
Aug 2019-Aug 2021

B.S.E in Computer Science
School of Engineering and Applied Science
Aug 2015-May 2019

Publications

  • Transform2Act: Learning a Transform-and-Control Policy for Efficient Agent Design
  • Ye Yuan, Yuda Song, Zhengyi Luo, Wen Sun, Kris M. Kitani
  • ICLR 2022 (Oral Presentation — Top 1.6%)
  • [Paper] [Project]
  • Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimation
  • Zhengyi Luo, Ryo hachiuma, Ye Yuan, Kris M. Kitani
  • ICCVW (CV4ARVR) 2021, NeurIPS 2021
  • [Video] [Paper] [Project] [Code]
  • 3D Human Motion Estimation via Motion Compression and Refinement
  • Zhengyi Luo, S. Alireza Golestaneh, Kris M. Kitani
  • ACCV 2020
  • Oral Presentation
  • [Video] [Paper] [Project] [Code]
  • Learning Shape Representations for Clothing Variations in Person Re-Identification
  • Yu-Jhe Li, Zhengyi Luo, Xinshuo Weng, Kris M. Kitani
  • arXiv, 2020
  • [Paper]
  • Cross-Domain 3D Equivariant Image Embeddings
  • Carlos Esteves, Avneesh Sud, Zhengyi Luo, Kostas Daniilidis, Ameesh Makadia
  • ICML 2019
  • [Paper]
  • Cloud Chaser: Real Time Deep Learning Computer Vision on Low Computing Power Devices
  • Zhengyi Luo, Austin Small, Liam Dugan, Stephen Lane
  • ICMV 2018
  • [Paper] [Project] [Code]
  • The rural–urban stress divide: Obtaining geographical insights through Twitter
  • Kokil Jaidka, Sharath Chandra Guntuku, Jane H Lee, Zhengyi Luo, Anneke Buffone, Lyle H Ungar
  • Computers in Human Behavior, 2020: 106544
  • [Paper] [Project]
  • Visual Analytics Approach to Vessel Behaviour Analysis
  • Liang Jin*, Zhengyi Luo*, Shu Gao
  • Journal of Navigation, 2018,71(5): 1195-1209
  • * indicates equal contribution

---

Industry Experience

  • 3D Software Engineer
  • Apple Inc
  • Technology Development Group, Applied Research For Reality Composer
  • May 2019-Aug 2019
  • 3D Software Engineer
  • Apple Inc
  • Technology Development Group, Applied Research For Reality Composer
  • May 2018-Aug 2018

---

Teaching Assistant Experience




---