Experimental browser for the Atmosphere
2. At the end of training, ICL doesn't give way to in-weights learning (IWL), as we previously thought. Instead, the model prefers a surprising strategy that is a *combination* of the two! We call this combo "cIWL" (context-constrained in-weights learning).
Mar 11, 2025, 6:18 PM
{ "uri": "at://did:plc:4utec3awlpc67cmu5yjue37r/app.bsky.feed.post/3lk4oiepcis2g", "cid": "bafyreidpmuzahszeadyxy3jy5me3dpzptsjgqgphqaheujj53xqqj7bzgy", "value": { "text": "2. At the end of training, ICL doesn't give way to in-weights learning (IWL), as we previously thought. Instead, the model prefers a surprising strategy that is a *combination* of the two!\n\nWe call this combo \"cIWL\" (context-constrained in-weights learning).", "$type": "app.bsky.feed.post", "embed": { "$type": "app.bsky.embed.images", "images": [ { "alt": "", "image": { "$type": "blob", "ref": { "$link": "bafkreigffcxddgk4t6otkwt3xhdon2dqry2fsrwsv6qmn27xjmoso7nlhi" }, "mimeType": "image/jpeg", "size": 358605 }, "aspectRatio": { "width": 1543, "height": 901 } } ] }, "langs": [ "en" ], "reply": { "root": { "cid": "bafyreihynobgihqqeykjikvcx7xovrfondzkwhin5mqzx7a3o44wmgjlj4", "uri": "at://did:plc:4utec3awlpc67cmu5yjue37r/app.bsky.feed.post/3lk4oiefov22g" }, "parent": { "cid": "bafyreidp54dn4tcl6g4amlkvruhzshfdgjrax7dln7ztechc2vpkfuskv4", "uri": "at://did:plc:4utec3awlpc67cmu5yjue37r/app.bsky.feed.post/3lk4oiep5mk2g" } }, "createdAt": "2025-03-11T18:18:13.342Z" } }