Poster · Paris
GSQ: Highly-Accurate Low-Precision Scalar Quantization for LLMs via Gumbel-Softmax Sampling
- When
- Wed 9 Dec 2026, 17:00–19:00 CET
- Where
- Paris Poster Hall
- Session
- Paris Poster Session 2
- Authors
- Alireza Dadgarnia, Rush Tabesh, Mahdi Nikdan, Michael Helcig, Eldar Kurtić, Maximilian Kleinegger, Dan Alistarh
- Organisations
- ISTAustria, Institute of Science and Technology Austria, ETH Zurich, NeuralMagic
- QRS classification
- Language models, Efficient and distributed ML systems