Poster · Sydney
PipeFSDP: Efficient Pipeline Parallel under Fully Sharded Data Parallel for Large Language Model Training
- When
- Wed 9 Dec 2026, 10:00–13:00 AEDT
- Where
- Hall 1-4, ICC Sydney
Exhibition Centre, Level 1 - Session
- Sydney Poster Session 3
- Authors
- Xinglin Pan, Mingji Han, Penghao Zhao, Lin Zheng, Rayying, key, Shaohuai Shi, Xiaowen Chu
- Organisations
- Hong Kong University of Science and Technology (Guangzhou), Tencent, Peking University, Fudan University, Tsinghua University, Harbin Institute of Technology
- QRS classification
- Language models