Experimental browser for the Atmosphere
3. A lot of previous work (including our own), has emphasized *competition* between in-context and in-weights learning. But we find that cIWL and ICL actually compete AND cooperate, via shared subcircuits. In fact, ICL cannot emerge if cIWL is blocked from emerging, even though ICL emerges first!
Mar 11, 2025, 6:18 PM
{ "uri": "at://did:plc:4utec3awlpc67cmu5yjue37r/app.bsky.feed.post/3lk4oifotc22g", "cid": "bafyreidmbsb5c3xt6gmhl6wrh5xxxeoztjcwqqx5jnb63i33gvygip6mxu", "value": { "text": "3. A lot of previous work (including our own), has emphasized *competition* between in-context and in-weights learning.\n\nBut we find that cIWL and ICL actually compete AND cooperate, via shared subcircuits. In fact, ICL cannot emerge if cIWL is blocked from emerging, even though ICL emerges first!", "$type": "app.bsky.feed.post", "embed": { "$type": "app.bsky.embed.images", "images": [ { "alt": "", "image": { "$type": "blob", "ref": { "$link": "bafkreibzct6alqi6lorptzemz3ml7fagmdesvi7f6d5xqfdba67jwpvaxe" }, "mimeType": "image/jpeg", "size": 113230 }, "aspectRatio": { "width": 756, "height": 389 } } ] }, "langs": [ "en" ], "reply": { "root": { "cid": "bafyreihynobgihqqeykjikvcx7xovrfondzkwhin5mqzx7a3o44wmgjlj4", "uri": "at://did:plc:4utec3awlpc67cmu5yjue37r/app.bsky.feed.post/3lk4oiefov22g" }, "parent": { "cid": "bafyreidpmuzahszeadyxy3jy5me3dpzptsjgqgphqaheujj53xqqj7bzgy", "uri": "at://did:plc:4utec3awlpc67cmu5yjue37r/app.bsky.feed.post/3lk4oiepcis2g" } }, "createdAt": "2025-03-11T18:18:13.343Z" } }