Wentao Zhu is a fourth-year Ph.D. student in Computer Science at Center on Frontiers of Computing Studies, Peking University. He is a member of the Computer Vision and Digital Art group, advised by Prof. Yizhou Wang. Previously, he received Bachelor's degrees in Computer Science and Economics from Peking University in 2020. |
Research
My research primarily focuses on building Human-aware AI systems that can perceive, understand, and interact with human beings. My long-term research goal is to create collaborative, embodied agents that can seamlessly integrate with human activities in real-world scenarios, such as home living, education, and manufacturing.
Selected Projects:
- Understanding humans (action, intention, belief): CelebV-HQ, MotionBERT, Social-CH, RepBelief
- Efficient and scalable AI for real-world deployments: Faster VoxelPose, DeTRC, Holistic Robot Pose
Preprints
Language Models Represent Beliefs of Self and Others Wentao Zhu, Zhining Zhang, Yizhou Wang arXiv preprint arXiv:2402.18496 Paper / Code / Project Page |
|
Efficient Action Counting with Dynamic Queries Zishi Li, Xiaoxuan Ma, Qiuyan Shang, Wentao Zhu, Hai Ci, Yu Qiao, Yizhou Wang arXiv preprint arXiv:2403.01543 Paper / Code / Project Page / Video |
|
Real-time Holistic Robot Pose Estimation with Unknown States Shikun Ban, Juling Fan, Wentao Zhu, Xiaoxuan Ma, Yu Qiao, Yizhou Wang arXiv preprint arXiv:2402.05655 Paper / Code / Project Page / Video |
Publications
2024
ScoreHypo: Probabilistic Human Mesh Estimation with Hypothesis Scoring Yuan Xu, Xiaoxuan Ma, Jiajun Su, Wentao Zhu, Yu Qiao, Yizhou Wang IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024 Paper / Code / Project Page / Video |
2023
Human Motion Generation: A Survey Wentao Zhu*, Xiaoxuan Ma*, Dongwoo Ro*, Hai Ci, Jinlu Zhang, Jiaxin Shi, Feng Gao, Qi Tian, Yizhou Wang IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023 Paper |
|
Social Motion Prediction with Cognitive Hierarchies Wentao Zhu*, Jason Qin*, Yuke Lou, Hang Ye, Xiaoxuan Ma, Hai Ci, Yizhou Wang Neural Information Processing Systems (NeurIPS), 2023 Paper / Code / Project Page / Video |
|
ChimpACT: A Longitudinal Dataset for
Understanding Chimpanzee Behaviors Xiaoxuan Ma*, Stephan P. Kaufhold*, Jiajun Su*, Wentao Zhu, Jack Terwilliger, Andres Meza, Yixin Zhu, Federico Rossano, Yizhou Wang Neural Information Processing Systems (NeurIPS, Datasets and Benchmarks Track), 2023 Paper / Code / Project Page / Video |
|
MotionBERT: A Unified Perspective on Learning Human Motion Representations Wentao Zhu, Xiaoxuan Ma, Zhaoyang Liu, Libin Liu, Wayne Wu, Yizhou Wang IEEE/CVF International Conference on Computer Vision (ICCV), 2023 Paper / Code / Project Page / Video |
|
GFPose: Learning 3D Human Pose Prior with Gradient Fields Hai Ci, Mingdong Wu, Wentao Zhu, Xiaoxuan Ma, Hao Dong, Fangwei Zhong, Yizhou Wang IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 Paper / Code / Project Page |
|
3D Human Mesh Estimation from Virtual Markers Xiaoxuan Ma, Chunyu Wang, Jiajun Su, Wentao Zhu, Yizhou Wang IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 Paper / Code / Project Page / Video |
2022
Faster VoxelPose: Real-time 3D Human Pose Estimation by Orthographic Projection Hang Ye*, Wentao Zhu*, Chunyu Wang, Rujie Wu, Yizhou Wang European Conference on Computer Vision (ECCV), 2022 Paper / Code |
|
CelebV-HQ: A Large-scale Video Facial Attributes Dataset Hao Zhu*, Wayne Wu*, Wentao Zhu, Liming Jiang, Siwei Tang, Li Zhang, Ziwei Liu, Chen Change Loy European Conference on Computer Vision (ECCV), 2022 Paper / Code / Project Page / Video |
|
MoCaNet: Motion Retargeting in-the-wild via Canonicalization Networks Wentao Zhu*, Zhuoqian Yang*, Ziang Di, Wayne Wu, Yizhou Wang, Chen Change Loy Thirty-Sixth AAAI Conference on Artificial Intelligence (AAAI), 2022 Paper / Code / Project Page |
2020
TransMoMo: Invariance-Driven Unsupervised Video Motion Retargeting Zhuoqian Yang*, Wentao Zhu*, Wayne Wu*, Chen Qian, Qiang Zhou, Bolei Zhou, Chen Change Loy IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020 Paper / Code / Project Page / Video |
Services
Academic
Conference Reviewer / PC Member:
CVPR, ECCV, ICCV, ICLR, AAAI, NeurIPS, IEEE VR, SIGGRAPH Asia
Journal Reviewer:
TPAMI, TOG, TVCG
Teaching
Robot Vision and Learning - From a Perspective of Embodied AI (TA) | Fall 2022 |
Practice of Programming in C & C++ (TA) | Spring 2021 |
Career Planning and Leadership Development (TA) | Fall 2020 |
I am fortunate enough to have worked with these brilliant undergraduate interns (ordered by year and last name):
Hang Ye (now Ph.D. student at PKU)
Jason Qin (now Ph.D. student at Stony Brook University)
Yuan Xu (incoming Ph.D. student at PKU)
Shikun Ban
Juling Fan
Zhining Zhang