Kaiyue Shen

shenkaiyue1997@gmail.com
I'm currently a Deep Learning Engineer at Arbrea Labs AG, Switzerland. I received my BSc in Electronic Information Engineering from University of Electronic Science and Technology of China (2019) where I wrote my Bachelor thesis under the supervision of Prof. Yang Hu on "Virtual Try-on based on Generative Adversarial Networks". I subsequently obtained a MSc in Electrical Engineering and Information Technology at ETH Zürich (2022). My master thesis was titled "X-Avatar: Expressive Human Avatars" supervised by Prof. Otmar Hilliges and got accepted by CVPR 2023. I worked as a research assistant at AIT lab, ETHZ between September 2022 and March 2023, focusing on the 3D digital human animation and human pose estimation. Before, I worked as a Computer Vision Intern at Seervision AG, Zürich from September 2021 to March 2022. My interests lie in the intersection between robotics and machine learning, ranging from 2D to 3D computer vision, including machine perception, reinforcement learning, digital humans.

Publications

Manuel Kaufmann, Jie Song, Chen Guo, Kaiyue Shen, Tianjian Jiang, Chengcheng Tang, Juan Zarate, Otmar Hilliges, EMDB: The Electromagnetic Database of Global 3D Human Pose and Shape in the Wild, ICCV 2023.
Kaiyue Shen*, Chen Guo*, Manuel Kaufmann, Juan Zarate, Julien Valentin, Jie Song, Otmar Hilliges, X-Avatar: Expressive Human Avatars, CVPR 2023.

Projects

EMDB: The Electromagnetic Database of Global 3D Human Pose and Shape in the Wild (ICCV 2023)
Research Assistant at Advanced Interactive Technologies Lab, ETHZ
Supervisors: Prof. Dr. Otmar Hilliges, Dr. Manuel Kaufmann
2022. 11 - 2023. 3
[Project Page][Paper][Code]
X-Avatar: Expressive Human Avatars (CVPR 2023)
Master Thesis at Advanced Interactive Technologies Lab, ETHZ
Supervisors: Prof. Dr. Otmar Hilliges, Dr. Jie Song, Chen Guo
2022. 4 - 2022. 11
[Project Page] [Paper] [Code]
Long term person Re-Indentification
Intern at Seervision AG, Zürich, Switzerland
2021. 9 - 2022. 3
[Project Page] [Internship Report] [Work Certificate]
Deep Learning for Autonomous Driving
Course project of Deep Learning for Autonomous Driving
Co-worker: Yunke Ao
2021. 3 - 2021. 7
[Project Page] [Report1] [Report2] [Report3-1] [Report3-2] [Code]
Continual learning for Binary Foreground and Background Segmentation
Semester Project at Autonomous Systems Lab, ETHZ
Supervisors: Prof. Dr. Roland Siegwart, Dr. Abel Gawel, Dr. Hermann Blum, Francesco Milano
2020. 10 - 2021. 3
[Project Page] [Semester Thesis] [Code]
Gradual Transition From Model-Based to Model-Free Actor-Critic Reinforcement Learning
Course project of Deep Learning
Co-workers: Le Chen, Yunke Ao, Zheyu Ye
2020. 10 - 2021. 1
[Project Page] [Paper] [Code]
Simple Hexapod Robot Control
Course project of Computational Models of Motion
Co-workers: Chao Ni, Ji Shi
2020. 5 - 2020. 6
[Project Page] [Code]
Object Reconstruction with Depth Error Compensation Using Azure Kinect
Course project of 3D Vision
Supervisor: Taein Kwon
Co-workers: Yunke Ao, Yifei Dong, Panayiotis Panayiotou
2020. 3 - 2020. 7
[Project Page] [Paper] [Code]
Virtual Try-on based on Generative Adversarial Networks
Undergraduate graduation project, Institute of Image Processing, UESTC
Supervisor: Prof. Dr. Yang Hu
2018. 7 - 2019.6
[Project Page] [Bachelor Thesis] [Code]