Photo of Zhiyu (Julius) Wu

Zhiyu (Julius) Wu

Ph.D. Student in Computer Science

University of Illinois Urbana-Champaign

About

I am a first-year Ph.D. student at UIUC, advised by Prof. Fan Lai. I’m broadly interested in Machine Learning Systems and efficient ML. Recently, I’ve become increasingly interested in Physical AI and Robotics, especially robot learning and the systems that make training and deploying embodied models efficient.

Previously, I was a software engineer at ByteDance, working on ML training systems and inference on TPUs.

Before that, I earned an M.S. in Computer Science at University of Illinois Urbana-Champaign, where I was also advised by Fan Lai, focusing on Machine Learning Systems.

I earned dual bachelor’s degrees from the University of Michigan and Shanghai Jiao Tong University. At Michigan, I had the privilege of working with Mosharaf Chowdhury and Amber Liu on Large Language Model (LLM) inference.

Here is my CV.

I’m always happy to chat, whether it’s about research, a potential collaboration, or anything ML systems. Feel free to drop me an email!

Interests

Family

Ari Wang

Publications

  1. NSDI 2026
    JITServe: SLO-aware LLM Serving with Imprecise Request Information
    Wei Zhang*, Zhiyu Wu*, Yi Mu, Rui Ning, Banruo Liu, Nikhil Sarda, Myungjin Lee, Fan Lai
    * Equal contribution
  2. Preprint 2026
    CacheFlow: Efficient LLM Serving with 3D-Parallel KV Cache Restoration
    Sean Nian, Jiahao Fang, Qilong Feng, Zhiyu Wu, Fan Lai
  3. NeurIPS 2025
    The ML.ENERGY Benchmark: Toward Automated Inference Energy Measurement and Optimization
    Jae-Won Chung, Jiachen Liu, Jeff J Ma, Ruofan Wu, Oh Jun Kweon, Yuxuan Xia, Zhiyu Wu, Mosharaf Chowdhury
    Spotlight
  4. Preprint 2024
    Andes: Defining and Enhancing Quality-of-Experience in LLM-Based Text Streaming Services
    Jiachen Liu, Zhiyu Wu, Jae-Won Chung, Fan Lai, Myungjin Lee, Mosharaf Chowdhury

Research projects →