Poster · Sydney

Positional versus Symbolic Attention Heads: Learning Dynamics, RoPE Geometry, and Length Generalization

Name: Positional versus Symbolic Attention Heads: Learning Dynamics, RoPE Geometry, and Length Generalization
Start: 2026-12-08T17:00:00+11:00
End: 2026-12-08T20:00:00+11:00
Location: Hall 1-4, ICC Sydney

When: Tue 8 Dec 2026, 17:00–20:00 AEDT
Where: Hall 1-4, ICC Sydney
Exhibition Centre, Level 1
Session: Sydney Poster Session 2
Authors: Felipe Urrutia, Juan J Alegría, Cinthia Sánchez, Jorge Salas, Cristian Buc Calderon, Cristobal Rojas
Organisations: Pontificia Universidad Catolica de Chile, U. Chile, CENIA, Centro Nacional de Inteligencia Artificial, Chilean National Center for Artificial Intelligence, IMC - Pontificia Universidad Catolica de Chile
QRS classification: Attention and transformers

Open in schedule Official page