Experimental browser for the Atmosphere
In our paper, we do the opposite. We investigate what happens when you only keep the position-to-position attention, and we show that you don't lose expressivity, with a log(n) cost, and a new learnability trade-off.
Feb 4, 2025, 4:52 PM
{ "uri": "at://did:plc:m4jauf4wb3kt2aveff3ej3jv/app.bsky.feed.post/3lhejexkcms2q", "cid": "bafyreifu24jt7ulrif3amrnnjxencwkjzhv47qkyzps4a77mcpgqbz4rci", "value": { "text": "In our paper, we do the opposite. We investigate what happens when you only keep the position-to-position attention, and we show that you don't lose expressivity, with a log(n) cost, and a new learnability trade-off.", "$type": "app.bsky.feed.post", "langs": [ "en" ], "reply": { "root": { "cid": "bafyreieeke6gzc4hqh76kqqanfhkifajqbfz7mghqxurvxgjjt45udfzia", "uri": "at://did:plc:m4jauf4wb3kt2aveff3ej3jv/app.bsky.feed.post/3lhdbjsgn4s23" }, "parent": { "cid": "bafyreifmjfhhxcbmw3wnuqtdmfz6zhu3jnzcpunr575f4t2qxaupnqlxvq", "uri": "at://did:plc:m4jauf4wb3kt2aveff3ej3jv/app.bsky.feed.post/3lhejews47k2q" } }, "createdAt": "2025-02-04T16:52:32.719Z" } }