Zhengyi (Zen) Luo

Hi there! My name is Zhengyi Luo (Zen) and I am a second year PhD student at Carnegie Mellon University’s Robotics Institute, School of Computer Science, advised by Prof. Kris Kitani. I earned my bachelor’s degree from University of Pennsylvania in 2019, where I worked with Prof. Kostas Daniilidis.

My research interest lies at the intersection of computer vision, machine learning, and robotics. I am working on topcis including human pose estimation, human-object interaction estimation, human motion generation etc. Through my research, I want to create methods that effectively interpret spatial-temporal sensory input and build a compositional representation of the 3D world to reason about the interactions between agents and the physical environment. On the application side, I am excited about building systems that would be useful as assistive robots, autonomous vehicles, and AR/VR virtual assistants.

Email / CV / Google Scholar / Github / Linkedin / Twitter

Pittsburgh PA, 15213

news

Sep 14, 2022	One paper on embodied human pose estimation accpeted to NeurIPS 2022!
Aug 30, 2022	Awarded Qualcomm Innovation Fellowship 2022!
Jan 28, 2022	One paper on simulated agent design accpeted to ICLR 2022!
Sep 28, 2021	One paper on egocentric human pose estimation accpeted to NeurIPS 2021!
Aug 31, 2021	Joined CMU RI as a PhD student.

Publications

Embodied Scene-aware Human Pose Estimation
Zhengyi Luo*, Shun Iwase*, Ye Yuan, Kris M. Kitani
NeurIPS 2022
* Equal contribution
[Paper] [Project]

From Universal Humanoid Control to Automatic Physically Valid Character Creation
Zhengyi Luo, Ye Yuan, Kris M. Kitani
In Submission
[Paper] [Project]

Transform2Act: Learning a Transform-and-Control Policy for Efficient Agent Design
Ye Yuan, Yuda Song, Zhengyi Luo, Wen Sun, Kris M. Kitani
ICLR 2022 (Oral Presentation — Top 1.6%)
[Paper] [Project]

Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimation
Zhengyi Luo, Ryo hachiuma, Ye Yuan, Kris M. Kitani
ICCVW (CV4ARVR) 2021, NeurIPS 2021
[Video] [Paper] [Project] [Code]

3D Human Motion Estimation via Motion Compression and Refinement
Zhengyi Luo, S. Alireza Golestaneh, Kris M. Kitani
ACCV 2020
Oral Presentation
[Video] [Paper] [Project] [Code]

Learning Shape Representations for Clothing Variations in Person Re-Identification
Yu-Jhe Li, Zhengyi Luo, Xinshuo Weng, Kris M. Kitani
arXiv, 2020
[Paper]

Cross-Domain 3D Equivariant Image Embeddings
Carlos Esteves, Avneesh Sud, Zhengyi Luo, Kostas Daniilidis, Ameesh Makadia
ICML 2019
[Paper]

Cloud Chaser: Real Time Deep Learning Computer Vision on Low Computing Power Devices
Zhengyi Luo, Austin Small, Liam Dugan, Stephen Lane
ICMV 2018
[Paper] [Project] [Code]

The rural–urban stress divide: Obtaining geographical insights through Twitter
Kokil Jaidka, Sharath Chandra Guntuku, Jane H Lee, Zhengyi Luo, Anneke Buffone, Lyle H Ungar
Computers in Human Behavior, 2020: 106544
[Paper] [Project]