Kaiyue Shen

shenkaiyue1997@gmail.com
I’m currently a Deep Learning & Computer Vision Engineer at Arbrea Labs AG, Switzerland.
I earned my BSc in Electronic Information Engineering from the University of Electronic Science and Technology of China (2019), where I completed my bachelor’s thesis under Prof. Yang Hu on Virtual Try-on using Generative Adversarial Networks. I then obtained my MSc in Electrical Engineering and Information Technology at ETH Zürich (2022). My master’s thesis, X-Avatar: Expressive Human Avatars, was supervised by Prof. Otmar Hilliges and accepted at CVPR 2023.
Between September 2022 and March 2023, I worked as a Research Assistant at the Advanced Interactive Technologies Lab (AIT), ETH Zürich, focusing on 3D digital human animation and human pose estimation. Prior to that, I was a Computer Vision Intern at Seervision AG, Zürich (September 2021 – March 2022).
My work focuses on digital humans and spans 2D and 3D computer vision, including reconstruction, animation, and modeling, with experience in both research and product development.
Outside of work, I’m an explorer at heart and enjoy skiing, tennis, badminton, fitness, hiking, cycling, archery, ice skating, and baking.

Publications

Manuel Kaufmann, Jie Song, Chen Guo, Kaiyue Shen, Tianjian Jiang, Chengcheng Tang, Juan Zarate, Otmar Hilliges, EMDB: The Electromagnetic Database of Global 3D Human Pose and Shape in the Wild, ICCV 2023.
Kaiyue Shen*, Chen Guo*, Manuel Kaufmann, Juan Zarate, Julien Valentin, Jie Song, Otmar Hilliges, X-Avatar: Expressive Human Avatars, CVPR 2023.

Projects

EMDB: The Electromagnetic Database of Global 3D Human Pose and Shape in the Wild (ICCV 2023)
Research Assistant at Advanced Interactive Technologies Lab, ETHZ
Supervisors: Prof. Dr. Otmar Hilliges, Dr. Manuel Kaufmann
2022. 11 - 2023. 3
[Project Page][Paper][Code]
X-Avatar: Expressive Human Avatars (CVPR 2023)
Master Thesis at Advanced Interactive Technologies Lab, ETHZ
Supervisors: Prof. Dr. Otmar Hilliges, Dr. Jie Song, Chen Guo
2022. 4 - 2022. 11
[Project Page] [Paper] [Code]
Long term person Re-Indentification
Intern at Seervision AG, Zürich, Switzerland
2021. 9 - 2022. 3
[Project Page] [Internship Report] [Work Certificate]
Deep Learning for Autonomous Driving
Course project of Deep Learning for Autonomous Driving
Co-worker: Yunke Ao
2021. 3 - 2021. 7
[Project Page] [Report1] [Report2] [Report3-1] [Report3-2] [Code]
Continual learning for Binary Foreground and Background Segmentation
Semester Project at Autonomous Systems Lab, ETHZ
Supervisors: Prof. Dr. Roland Siegwart, Dr. Abel Gawel, Dr. Hermann Blum, Francesco Milano
2020. 10 - 2021. 3
[Project Page] [Semester Thesis] [Code]
Gradual Transition From Model-Based to Model-Free Actor-Critic Reinforcement Learning
Course project of Deep Learning
Co-workers: Le Chen, Yunke Ao, Zheyu Ye
2020. 10 - 2021. 1
[Project Page] [Paper] [Code]
Simple Hexapod Robot Control
Course project of Computational Models of Motion
Co-workers: Chao Ni, Ji Shi
2020. 5 - 2020. 6
[Project Page] [Code]
Object Reconstruction with Depth Error Compensation Using Azure Kinect
Course project of 3D Vision
Supervisor: Taein Kwon
Co-workers: Yunke Ao, Yifei Dong, Panayiotis Panayiotou
2020. 3 - 2020. 7
[Project Page] [Paper] [Code]
Virtual Try-on based on Generative Adversarial Networks
Undergraduate graduation project, Institute of Image Processing, UESTC
Supervisor: Prof. Dr. Yang Hu
2018. 7 - 2019.6
[Project Page] [Bachelor Thesis] [Code]