I am a Computer Science Ph.D. student at University of Illinois Urbana-Champaign (UIUC), advised by Prof. Han Zhao. Previously, I obtained my dual bachelor’s degree in Data Science from the University of Michigan (UM) and in Electrical and Computer Engineering from Shanghai Jiao Tong University (SJTU).

My research interest is centered around trustworthy machine learning. I currently work on i) Improving the multi-task capabilities of foundation models (e.g, multilingual LLMs, model merging). ii) Enhancing the efficiency of LLMs (e.g., semi-supervised learning, MoE). Previously, I have worked on domain adaptation/generalization and multimodal learning.

News

• [Oct 2024] My Microsoft internship work on Multilingual Scaling Laws is out! With this law, you can compute optimal sampling ratios of langauges to design your multilingual pretraining mixture for any model size!
• [Sept 2024] Check out our new work Localize-and-Stitch on how better localization improves model merging!
• [Sept 2024] Semi-Supervised Reward Modeling (SSRM) is accepted at EMNLP 2024!
• [Aug 2024] Start internship at Microsoft GenAI!
• [May 2024] Start internship at Microsoft Turing!
• [May 2024] Our work on robust multi-task learning is accepted at ICML 2024!
• [May 2024] Our work on gradual domain adaptation is accepted at JMLR!
• [May 2023] Start internship at Amazon!