Experimental browser for the Atmosphere
Not to mention, predicting tokens is only the *pre-training* task. Any model you're interacting with (eg. Claude) is trained by RLHF to answer questions in a way that people rate positively. If you call this prediction, then all of cognition and action is prediction (a popular theory, of course).
Dec 7, 2024, 8:40 PM
{ "uri": "at://did:plc:fk3wl5kkfeclz4w264m6d3tk/app.bsky.feed.post/3lcqkllwqm22b", "cid": "bafyreifn2d6lwlu4mcwnpqd4usezrsavuwpash3w4ynu2zqfjqtrvrfvla", "value": { "text": "Not to mention, predicting tokens is only the *pre-training* task. Any model you're interacting with (eg. Claude) is trained by RLHF to answer questions in a way that people rate positively. If you call this prediction, then all of cognition and action is prediction (a popular theory, of course).", "$type": "app.bsky.feed.post", "langs": [ "en" ], "reply": { "root": { "cid": "bafyreia6vqxfrzez37xmvd4p7s7lhzp3vwnazhaxs7sgyiqpgjnuufarnq", "uri": "at://did:plc:c2xl6zaxo623jzbjb43urymd/app.bsky.feed.post/3knxuxa3tvc2k" }, "parent": { "cid": "bafyreiadeqlijwbrvstdgwcum2gnq22bb76bmagmej4c5e2imj6chbcjsi", "uri": "at://did:plc:7mj2witlwu5rebg5wsrmrgos/app.bsky.feed.post/3lcic25r2vs2o" } }, "createdAt": "2024-12-07T20:40:08.680Z" } }