ATProto Browser

ATProto Browser

Experimental browser for the Atmosphere

Post

3. A lot of previous work (including our own), has emphasized *competition* between in-context and in-weights learning. But we find that cIWL and ICL actually compete AND cooperate, via shared subcircuits. In fact, ICL cannot emerge if cIWL is blocked from emerging, even though ICL emerges first!

Mar 11, 2025, 6:18 PM

Record data

{
  "uri": "at://did:plc:4utec3awlpc67cmu5yjue37r/app.bsky.feed.post/3lk4oifotc22g",
  "cid": "bafyreidmbsb5c3xt6gmhl6wrh5xxxeoztjcwqqx5jnb63i33gvygip6mxu",
  "value": {
    "text": "3. A lot of previous work (including our own), has emphasized *competition* between in-context and in-weights learning.\n\nBut we find that cIWL and ICL actually compete AND cooperate, via shared subcircuits. In fact, ICL cannot emerge if cIWL is blocked from emerging, even though ICL emerges first!",
    "$type": "app.bsky.feed.post",
    "embed": {
      "$type": "app.bsky.embed.images",
      "images": [
        {
          "alt": "",
          "image": {
            "$type": "blob",
            "ref": {
              "$link": "bafkreibzct6alqi6lorptzemz3ml7fagmdesvi7f6d5xqfdba67jwpvaxe"
            },
            "mimeType": "image/jpeg",
            "size": 113230
          },
          "aspectRatio": {
            "width": 756,
            "height": 389
          }
        }
      ]
    },
    "langs": [
      "en"
    ],
    "reply": {
      "root": {
        "cid": "bafyreihynobgihqqeykjikvcx7xovrfondzkwhin5mqzx7a3o44wmgjlj4",
        "uri": "at://did:plc:4utec3awlpc67cmu5yjue37r/app.bsky.feed.post/3lk4oiefov22g"
      },
      "parent": {
        "cid": "bafyreidpmuzahszeadyxy3jy5me3dpzptsjgqgphqaheujj53xqqj7bzgy",
        "uri": "at://did:plc:4utec3awlpc67cmu5yjue37r/app.bsky.feed.post/3lk4oiepcis2g"
      }
    },
    "createdAt": "2025-03-11T18:18:13.343Z"
  }
}