I’m a fourth-year Ph.D. candidate in Computer Science, working in the Distributed Systems Lab at the University of Pennsylvania, advised by Prof. Boon Thau Loo and Prof. Vincent Liu.

My research focuses on resource‑efficient systems for large language models, specifically:

• Scalable serving architecture for large-scale, multimodal LLMs
• Reinforcement-learning systems for reasoning models.

Feel free to reach out if this aligns with your interests.

Prior to Penn, I was a Master’s student at Columbia University, where I researched on privacy-preserving model training with Prof. Asaf Cidon. I also collaborated with Prof. Ethan Katz-Bassett, Prof. Roxana Geambasu, Prof. Ryan Stutsman and Prof. Mathias Lécuyer.

Before coming to the U.S., I developed quantitative investment algorithm and systems in the financial sector. I earned my B.S. in Financial Mathematics in 2015 from Southern University of Science and Technology, as a member of its founding cohort.

Selected Projects

GPU Multiplexing for Multiple Heterogenous LLMs Serving

• Eliminated head-of-line blocking via novel LLM serving architecture, raising token throughput by 1.6×.
• Engineered efficient multi-model KV cache management and robust NCCL concurrency controls.
• Optimized sharding, replication, placement, and scheduling strategies.

Serving Multimodal LLMs via Shared Backbone

• Contributing the GPU multiplexing source code to the shared backbone architecture for multimodal LLM serving.
• Proposing system design and implementation details by leveraging expertise in vLLM and Ray.
• Identified the applicability of Coflow scheduling, influencing the project’s scheduling approach.

Privacy Budget Scheduling in Machine Learning Training

• Scheduled 2× more jobs than FCFS under identical privacy budgets.
• Proposed a dynamic algorithm DPF (Dominant Private Block Fairness) based on DRF (dominant resource fairness).
• Developed rigorous proofs for the game-theory properties of the new algorithm.

I also researched fault-tolerant distributed storage.

Awards

• Manjushri Fellowship by University of Pennsylvania, 2021
• Financial Risk Manager (FRM) Certification, 2015
• China Merchant Bank Scholarship, 2012-2014
• Pioneering Undergraduate Fellowship, 2011-2014
• First Prize in China High School Biology Olympiad, 2010