01Entry
SAS: Simple Attention Sparsification via End-to-End Optimization of Context Ranking
SAS trains a selector end-to-end with LM loss via continuous gating in attention softmax — sparse attention that doesn't sacrifice quality, directly relevant to long-context agent cost.