About

Hey, I'm Jie Hu, a PhD candidate at the Center for Data Science, Peking University, where I am incredibly fortunate to be advised by Prof. Zaiwen Wen and Prof. Kun Yuan. Previously, I obtained my B.S. in Applied Mathematics from Tongji University in 2023.

My research lies at the intersection of machine learning algorithms and systems, focusing on efficient and scalable large language models. I'm broadly interested in efficient inference, agentic systems, RL infrastructure, and model–system co-design. I'm currently a research intern at Tencent Hunyuan, working on algorithms and systems for efficient large-scale LLM deployment.

Feel free to reach out via email—always happy to connect and exchange ideas!

News

  • 2026.09 Started as a research intern at Tencent Hunyuan, working on algorithms and systems for efficient large-scale LLM deployment.
  • 2026.09 TierKV is accepted to EuroSys 2027 — long-context on-device LLMs via predictive multi-tier KV caching.
  • 2026.05 DFSAttn is accepted to ICML 2026 — dynamic fine-grained sparse attention for faster video generation.
  • 2026.01 Passed the doctoral qualifying exam and became a PhD candidate.
  • 2025.07 Wrapped up a one-year research internship at Huawei 2012 Lab.
  • 2025.06 CentroidKV is on arXiv, and later accepted to TMLR — online KV cache clustering for long-context LLM inference.
  • 2024.05 Our work Distributed Bilevel Optimization with Communication Compression is accepted to ICML 2024.
  • 2023.09 Started my PhD at the Center for Data Science, Peking University.

Publications

  1. ICML 2026
    DFSAttn: Dynamic Fine-grained Sparse Attention for Efficient Video Generation
    Jie Hu, Zixiang Gao, Yutong He, Kun Yuan
    International Conference on Machine Learning (ICML), 2026
  2. TMLR
    CentroidKV: Efficient Long-Context LLM Inference via KV Cache Clustering
    Jie Hu*, Shengnan Wang*, Yutong He, Ping Gong, Jiawei Yi, Juncheng Zhang, Youhui Bai, Renhai Chen, Gong Zhang, Cheng Li, Kun Yuan
    Transactions on Machine Learning Research (TMLR), 2025
    * Equal contribution
  3. EuroSys 2027
    TierKV: Long-Context On-Device LLMs via Predictive Multi-Tier KV Caching
    Zhihao Shu, Md Musfiqur Rahman Sanim, Jie Hu, Kun Yuan, Minghai Qin, Gagan Agrawal, Wei Niu
    European Conference on Computer Systems (EuroSys), 2027
  4. ICML 2024
    Distributed Bilevel Optimization with Communication Compression
    Yutong He*, Jie Hu*, Xinmeng Huang, Songtao Lu, Bin Wang, Kun Yuan
    International Conference on Machine Learning (ICML), 2024
    * Equal contribution

For the full and most up-to-date list, see my Google Scholar profile.

Experience

Tencent Hunyuan, Beijing

Research Intern — Efficient LLM Algorithms & Systems

2026.09 – Present

Huawei 2012 Lab, Beijing

Research Intern

2024.08 – 2025.07

Education

Peking University, Beijing

Ph.D. in Data Science · Center for Data Science

2023.09 – Present

Tongji University, Shanghai

B.S. in Applied Mathematics

2019.09 – 2023.06

Teaching

Selected Awards

Merit Student, Peking University
2024
Industrial Bank Scholarship, Peking University
2024
Outstanding Student, Tongji University
2021, 2022
First-class Scholarship, Tongji University
2021, 2022