Experimental browser for the Atmosphere
This post by @gunnarmorling.dev has some excellent ideas to build the Kafka.next. Includes: - No partitions - Topic hierarchies - Concurrency control - Broker-side schema support - Synchronous commit callbacks - Snapshotting - Built on LSM Tree www.morling.dev/blog/what-if...
Apr 26, 2025, 11:21 AM
{ "uri": "at://did:plc:iwpxnj7rzdynjkkr7rxaa5is/app.bsky.feed.post/3lnpmny7gds2t", "cid": "bafyreigklgtbudkrnnzjr7xirlwfeg6wyca7owx446y6v6yeufxbpavkyi", "value": { "text": "This post by @gunnarmorling.dev has some excellent ideas to build the Kafka.next. Includes: \n\n- No partitions\n- Topic hierarchies\n- Concurrency control\n- Broker-side schema support\n- Synchronous commit callbacks\n- Snapshotting\n- Built on LSM Tree\n\nwww.morling.dev/blog/what-if...", "$type": "app.bsky.feed.post", "embed": { "$type": "app.bsky.embed.images", "images": [ { "alt": "What If We Could Rebuild Kafka From Scratch?\n\n\nThe last few days I spent some time digging into the recently announced KIP-1150 (\"Diskless Kafka\"), as well AutoMQ’s Kafka fork, tightly integrating Apache Kafka and object storage, such as S3. Following the example set by WarpStream, these projects aim to substantially improve the experience of using Kafka in cloud environments, providing better elasticity, drastically reducing cost, and paving the way towards native lakehouse integration.\n\n", "image": { "$type": "blob", "ref": { "$link": "bafkreidgxkj5okv2b5kmu3pp27we7s5h3ui24ldlljtk7i3t2gxbev2zga" }, "mimeType": "image/jpeg", "size": 310072 }, "aspectRatio": { "width": 1172, "height": 896 } } ] }, "langs": [ "en" ], "facets": [ { "$type": "app.bsky.richtext.facet", "index": { "byteEnd": 31, "byteStart": 13 }, "features": [ { "did": "did:plc:a6kts6emu6245qj6t4wn35nw", "$type": "app.bsky.richtext.facet#mention" } ] }, { "index": { "byteEnd": 80, "byteStart": 70 }, "features": [ { "uri": "https://Kafka.next", "$type": "app.bsky.richtext.facet#link" } ] }, { "index": { "byteEnd": 279, "byteStart": 248 }, "features": [ { "uri": "https://www.morling.dev/blog/what-if-we-could-rebuild-kafka-from-scratch/", "$type": "app.bsky.richtext.facet#link" } ] } ], "createdAt": "2025-04-26T11:21:44.305Z" } }