Zhengyi (Zen) Luo

Hi there! My name is Zhengyi Luo (Zen) and I am a second year PhD student at Carnegie Mellon University’s Robotics Institute, School of Computer Science, advised by Prof. Kris Kitani. I earned my bachelor’s degree from University of Pennsylvania in 2019, where I worked with Prof. Kostas Daniilidis.

My research interest lies at the intersection of computer vision, machine learning, and robotics. I am working on topcis including human pose estimation, human-object interaction estimation, human motion generation etc. Through my research, I want to create methods that effectively interpret spatial-temporal sensory input and build a compositional representation of the 3D world to reason about the interactions between agents and the physical environment. On the application side, I am excited about building systems that would be useful as assistive robots, autonomous vehicles, and AR/VR virtual assistants.

Pittsburgh PA, 15213

news

Sep 14, 2022 One paper on embodied human pose estimation accpeted to NeurIPS 2022!
Aug 30, 2022 Awarded Qualcomm Innovation Fellowship 2022!
Jan 28, 2022 One paper on simulated agent design accpeted to ICLR 2022!
Sep 28, 2021 One paper on egocentric human pose estimation accpeted to NeurIPS 2021!
Aug 31, 2021 Joined CMU RI as a PhD student.

Publications

  • Embodied Scene-aware Human Pose Estimation
  • Zhengyi Luo*, Shun Iwase*, Ye Yuan, Kris M. Kitani
  • NeurIPS 2022
  • * Equal contribution
  • [Paper] [Project]
  • From Universal Humanoid Control to Automatic Physically Valid Character Creation
  • Zhengyi Luo, Ye Yuan, Kris M. Kitani
  • In Submission
  • [Paper] [Project]
  • Transform2Act: Learning a Transform-and-Control Policy for Efficient Agent Design
  • Ye Yuan, Yuda Song, Zhengyi Luo, Wen Sun, Kris M. Kitani
  • ICLR 2022 (Oral Presentation — Top 1.6%)
  • [Paper] [Project]
  • Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimation
  • Zhengyi Luo, Ryo hachiuma, Ye Yuan, Kris M. Kitani
  • ICCVW (CV4ARVR) 2021, NeurIPS 2021
  • [Video] [Paper] [Project] [Code]
  • 3D Human Motion Estimation via Motion Compression and Refinement
  • Zhengyi Luo, S. Alireza Golestaneh, Kris M. Kitani
  • ACCV 2020
  • Oral Presentation
  • [Video] [Paper] [Project] [Code]
  • Learning Shape Representations for Clothing Variations in Person Re-Identification
  • Yu-Jhe Li, Zhengyi Luo, Xinshuo Weng, Kris M. Kitani
  • arXiv, 2020
  • [Paper]
  • Cross-Domain 3D Equivariant Image Embeddings
  • Carlos Esteves, Avneesh Sud, Zhengyi Luo, Kostas Daniilidis, Ameesh Makadia
  • ICML 2019
  • [Paper]
  • Cloud Chaser: Real Time Deep Learning Computer Vision on Low Computing Power Devices
  • Zhengyi Luo, Austin Small, Liam Dugan, Stephen Lane
  • ICMV 2018
  • [Paper] [Project] [Code]
  • The rural–urban stress divide: Obtaining geographical insights through Twitter
  • Kokil Jaidka, Sharath Chandra Guntuku, Jane H Lee, Zhengyi Luo, Anneke Buffone, Lyle H Ungar
  • Computers in Human Behavior, 2020: 106544
  • [Paper] [Project]
  • Visual Analytics Approach to Vessel Behaviour Analysis
  • Liang Jin*, Zhengyi Luo*, Shu Gao
  • Journal of Navigation, 2018,71(5): 1195-1209
  • * indicates equal contribution

---



Industry Experience

  • 3D Software Engineer
  • Apple Inc
  • Technology Development Group, Applied Research For Reality Composer
  • May 2019-Aug 2019
  • 3D Software Engineer
  • Apple Inc
  • Technology Development Group, Applied Research For Reality Composer
  • May 2018-Aug 2018

---


Teaching Assistant Experience




---