ATProto Browser

ATProto Browser

Experimental browser for the Atmosphere

Post

Clustering pipeline on 6.6m Bluesky posts currently takes 1 hour 44 minutes on my Macbook Pro. Good news is that it now actually works without any errors or bugs, so I can probably productionalize it and run it on a GPU next week instead.

May 4, 2025, 5:56 AM

Record data

{
  "uri": "at://did:plc:al773bhtogn7xidgsq2cbbpn/app.bsky.feed.post/3lod6a4r6ms2a",
  "cid": "bafyreigd3c2owmgcnyfkg3jpzxuf4kr47xup4ksnaydchp63m5zy6a7une",
  "value": {
    "text": "Clustering pipeline on 6.6m Bluesky posts currently takes 1 hour 44 minutes on my Macbook Pro. \n\nGood news is that it now actually works without any errors or bugs, so I can probably productionalize it and run it on a GPU next week instead.",
    "$type": "app.bsky.feed.post",
    "embed": {
      "alt": "log output for the clustering job on 6.6m Bluesky posts for the week",
      "$type": "app.bsky.embed.video",
      "video": {
        "$type": "blob",
        "ref": {
          "$link": "bafkreickojizojyrve5vymltzdemfhiocmwyqkbeo7cc5bw2by5rwfrake"
        },
        "mimeType": "video/mp4",
        "size": 11581333
      },
      "aspectRatio": {
        "width": 1280,
        "height": 512
      }
    },
    "langs": [
      "en"
    ],
    "createdAt": "2025-05-04T05:56:41.704Z"
  }
}