Experimental browser for the Atmosphere
Synchronous inference is what everyone does currently. Send a request, wait for an answer. Async means you can ignore immediately responses and perform inference at a time of your choosing. Async != batching, but async makes batching significantly more cost effective.
May 7, 2025, 7:36 PM
{ "uri": "at://did:plc:7fqehwc2d5mbltmxpgnbeimj/app.bsky.feed.post/3lom5gjdcpk2c", "cid": "bafyreigjinhe3b37vthko2s2znh3wxgz7hnc4widnozngvcjjluc6oh2ei", "value": { "text": "Synchronous inference is what everyone does currently. Send a request, wait for an answer. Async means you can ignore immediately responses and perform inference at a time of your choosing. \n\nAsync != batching, but async makes batching significantly more cost effective.", "$type": "app.bsky.feed.post", "langs": [ "en" ], "reply": { "root": { "cid": "bafyreiad7a2zvr5ebmes7eiw2yk26ukvoginmethzx35fmjcqatsi76ooe", "uri": "at://did:plc:ckaz32jwl6t2cno6fmuw2nhn/app.bsky.feed.post/3loj6fjm5n22z" }, "parent": { "cid": "bafyreibrbmzig7d7k3c4glgbtqun2t5v2kk26tfiq3mvs7gt6bsr5ax7iq", "uri": "at://did:plc:ckaz32jwl6t2cno6fmuw2nhn/app.bsky.feed.post/3lolxnqotqk2b" } }, "createdAt": "2025-05-07T19:36:20.110Z" } }