Nearest Neighbor at Every Length: Rank-One Softmax and Hardmax Transformers
transformers attention softmax preprint expressivity low-rank context-length nearest-neighbor-retrieval hardmax
-
Updated
Jul 30, 2026 - TeX