Experimental browser for the Atmosphere
what do you mean by synchronous inference? are you saying async is batching? and if so, why can’t you do batching in a sync api?
May 7, 2025, 5:53 PM
{ "uri": "at://did:plc:ckaz32jwl6t2cno6fmuw2nhn/app.bsky.feed.post/3lolxnqotqk2b", "cid": "bafyreibrbmzig7d7k3c4glgbtqun2t5v2kk26tfiq3mvs7gt6bsr5ax7iq", "value": { "text": "what do you mean by synchronous inference?\n\nare you saying async is batching? and if so, why can’t you do batching in a sync api?", "$type": "app.bsky.feed.post", "langs": [ "en" ], "reply": { "root": { "cid": "bafyreiad7a2zvr5ebmes7eiw2yk26ukvoginmethzx35fmjcqatsi76ooe", "uri": "at://did:plc:ckaz32jwl6t2cno6fmuw2nhn/app.bsky.feed.post/3loj6fjm5n22z" }, "parent": { "cid": "bafyreidesztko5fetgtauyg2uaog5hw644gsa7fhe5tyn4n5oittmnuuz4", "uri": "at://did:plc:7fqehwc2d5mbltmxpgnbeimj/app.bsky.feed.post/3loluadzwsc2d" } }, "createdAt": "2025-05-07T17:53:00.259Z" } }