Poster · Sydney
An Empirical Study on Noisy Data and LLM Pretraining Loss Divergence
- When
- Tue 8 Dec 2026, 10:00–13:00 AEDT
- Where
- Hall 1-4, ICC Sydney
Exhibition Centre, Level 1 - Session
- Sydney Poster Session 1
- Authors
- Qizhen (Irene) Zhang, Ankush Garg, Jakob Foerster, Niladri S. Chatterji, Kshitiz Malik, Mike Lewis
- Organisations
- University of Oxford, Google, Stanford University, University of Illinois Urbana-Champaign, Meta
- QRS classification
- Language models