Biography
Chaoyang He is a Ph.D. Candidate in the CS department at the University of Southern California, Los Angeles, USA. He is co-advised by Professor Salman Avestimehr and Professor Mahdi Soltanolkotabi. He further collaborates with other faculties at USC, in particular Professor Murali Annavaram. He also works closely with researchers/engineers at Google, Facebook, Amazon, and Tencent. Previously, He was an R&D Team Manager and Staff Software Engineer at Tencent (2014-2018), a Team Leader and Senior Software Engineer at Baidu (2012-2014), and a Software Engineer at Huawei (2011-2012). He has received a number of awards in the Internet and Telecommunication industry, including Tencent Outstanding Staff Award (2015-2016), WeChat Special Award for Innovation (2016), Baidu LBS Group Star Awards (2013), and Huawei Golden Network Award (2012). He does research on distributed/federated machine learning algorithms, systems, and applications. During his Ph.D. study, he has published papers at ICML, NeurIPS, CVPR, ICLR, MLSys, etc. With his advisors, he also co-founds FedML.ai, built based on a paper that won Best Paper Award at NeurIPS 2020 FL workshop.
Research Interests
The goal of my Ph.D. career is to develop distributed/federated, automated, and trustworthy machine learning algorithms and systems. Recently, I am focusing on:
1. Large-scale distributed training algorithms and systems for massive-scale DNN models (Transformers, ViT, BERT, MoE, etc.)
2. Federated learning algorithms, models, systems, and their applications in CV, NLP, Data Mining, and IoT.
3. Automated machine learning (AutoML) with Neural Architecture Search.
What does being an Amazon ML Fellow mean to you?
“This fellowship means a lot to me. It encourages me to explore further with flexibility and trust. I am always a long-termist. After getting first-hand experience in both industry and academia, I hope to have unique perspectives on research, engineering, and entrepreneurship and eventually innovate something different. This is my dream. Thanks for Amazon's generous support in this journey.”