Poster · Sydney
Tackling the Data-Parallel Load Balancing Bottleneck in LLM Serving: Practical Online Routing at Scale
- When
- Thu 10 Dec 2026, 10:00–13:00 AEDT
- Where
- Hall 1-4, ICC Sydney
Exhibition Centre, Level 1 - Session
- Sydney Poster Session 5
- Authors
- Tianci Bu, Yuan Lyu, Zixi Chen, Chendong Song, Hong Liang, Tsepten Gurung, Yuwei Fan, Yinyu Ye, Zijie Zhou
- Organisations
- Hong Kong University of Science and Technology, Huawei, Peking University, University of North Carolina at Chapel Hill, Standord
- QRS classification
- Language models