ATProto Browser

ATProto Browser

Experimental browser for the Atmosphere

Post

2. At the end of training, ICL doesn't give way to in-weights learning (IWL), as we previously thought. Instead, the model prefers a surprising strategy that is a *combination* of the two! We call this combo "cIWL" (context-constrained in-weights learning).

Mar 11, 2025, 6:18 PM

Record data

{
  "uri": "at://did:plc:4utec3awlpc67cmu5yjue37r/app.bsky.feed.post/3lk4oiepcis2g",
  "cid": "bafyreidpmuzahszeadyxy3jy5me3dpzptsjgqgphqaheujj53xqqj7bzgy",
  "value": {
    "text": "2. At the end of training, ICL doesn't give way to in-weights learning (IWL), as we previously thought. Instead, the model prefers a surprising strategy that is a *combination* of the two!\n\nWe call this combo \"cIWL\" (context-constrained in-weights learning).",
    "$type": "app.bsky.feed.post",
    "embed": {
      "$type": "app.bsky.embed.images",
      "images": [
        {
          "alt": "",
          "image": {
            "$type": "blob",
            "ref": {
              "$link": "bafkreigffcxddgk4t6otkwt3xhdon2dqry2fsrwsv6qmn27xjmoso7nlhi"
            },
            "mimeType": "image/jpeg",
            "size": 358605
          },
          "aspectRatio": {
            "width": 1543,
            "height": 901
          }
        }
      ]
    },
    "langs": [
      "en"
    ],
    "reply": {
      "root": {
        "cid": "bafyreihynobgihqqeykjikvcx7xovrfondzkwhin5mqzx7a3o44wmgjlj4",
        "uri": "at://did:plc:4utec3awlpc67cmu5yjue37r/app.bsky.feed.post/3lk4oiefov22g"
      },
      "parent": {
        "cid": "bafyreidp54dn4tcl6g4amlkvruhzshfdgjrax7dln7ztechc2vpkfuskv4",
        "uri": "at://did:plc:4utec3awlpc67cmu5yjue37r/app.bsky.feed.post/3lk4oiep5mk2g"
      }
    },
    "createdAt": "2025-03-11T18:18:13.342Z"
  }
}