Experimental browser for the Atmosphere
If anyone is interested in a deep read into random access performance + Parquet then we've put out a preprint: arxiv.org/abs/2504.15247 Parquet is not really as bad as it's reputation implies (though of course I am biased towards Lance 😛, and there are valid limitations in Parquet re: RAM)
Apr 23, 2025, 11:13 PM
{ "uri": "at://did:plc:odt76ndwgegtwjjjtd46ht4i/app.bsky.feed.post/3lnjczzvowk2r", "cid": "bafyreif3uban6ik2ud5f2f3zbfwokupbljf6pama2ftqy6gwbko2djqpcm", "value": { "text": "If anyone is interested in a deep read into random access performance + Parquet then we've put out a preprint: arxiv.org/abs/2504.15247\n\nParquet is not really as bad as it's reputation implies (though of course I am biased towards Lance 😛, and there are valid limitations in Parquet re: RAM)", "$type": "app.bsky.feed.post", "embed": { "$type": "app.bsky.embed.external", "external": { "uri": "https://arxiv.org/abs/2504.15247", "thumb": { "$type": "blob", "ref": { "$link": "bafkreiat54o5p6krvcmq2blj3e32a2q6bibvjwoqtr3pltgvmiwg37sevm" }, "mimeType": "image/jpeg", "size": 178376 }, "title": "Lance: Efficient Random Access in Columnar Storage through Adaptive Structural Encodings", "description": "The growing interest in artificial intelligence has created workloads that require both sequential and random access. At the same time, NVMe-backed storage solutions have emerged, providing caching ca..." } }, "langs": [ "en" ], "facets": [ { "index": { "byteEnd": 135, "byteStart": 111 }, "features": [ { "uri": "https://arxiv.org/abs/2504.15247", "$type": "app.bsky.richtext.facet#link" } ] } ], "createdAt": "2025-04-23T23:13:32.889Z" } }