ATProto Browser
Experimental browser for the Atmosphere
Experimental browser for the Atmosphere
That’s part of the issue. Part of the issue is that LLM generated data is poisoning the training set for later models. We’re well past diminishing returns for this technique too, and now we’re into the range where optimizing for some things (math “reasoning” generally) has serious tradeoffs.
May 7, 2025, 3:17 PM
{
"uri": "at://did:plc:vbufq3xwt3233giwk4ulgvpr/app.bsky.feed.post/3loloxdssc22a",
"cid": "bafyreian6rqwdksadrtq4uku5vlmg337zlppwx3fjudqbdoeeoudugy3je",
"value": {
"text": "That’s part of the issue. Part of the issue is that LLM generated data is poisoning the training set for later models. \n\nWe’re well past diminishing returns for this technique too, and now we’re into the range where optimizing for some things (math “reasoning” generally) has serious tradeoffs.",
"$type": "app.bsky.feed.post",
"langs": [
"en"
],
"reply": {
"root": {
"cid": "bafyreibi2ixgzsxqsum4hoh6fwnuaxilqhabibuqegwbwaybrupyszfxpy",
"uri": "at://did:plc:gcoiabsumehr3g6sbimjrqpx/app.bsky.feed.post/3lojlginjys2r"
},
"parent": {
"cid": "bafyreidhblgms6jk42zmjllk4frpnljf6nrfbwolvvmvzj52xo5rlckrpa",
"uri": "at://did:plc:eam2ajzivcp7rhzod4kgnn6k/app.bsky.feed.post/3lolotynkws26"
}
},
"createdAt": "2025-05-07T15:17:18.624Z"
}
}