Poster · Atlanta

Attention Sinks and Outliers in Attention Residuals

Name: Attention Sinks and Outliers in Attention Residuals
Start: 2026-12-10T16:30:00-05:00
End: 2026-12-10T19:30:00-05:00
Location: Hall C1, Georgia World Congress Center

When: Thu 10 Dec 2026, 16:30–19:30 EST
Where: Hall C1, Georgia World Congress Center
Session: Atlanta Poster Session 4
Authors: Haozheng Luo, Haoran Dai, Shaoyang Zhang, Xi Chen, Eric Hanchen Jiang, Yijiang Li, Ching-Yuen Huang, Chenghao Qiu, Chenwei Xu, Zhenyu Pan, Haotian Zhang, Binghui Wang and 1 more
Organisations: Northwestern University, Illinois Institute of Technology, University of Michigan, University of California, Los Angeles, University of California, San Diego, Rutgers University, Texas A&M University, Quiver.Ai
QRS classification: Attention and transformers, Efficient and distributed ML systems

Open in schedule Official page