Experimental browser for the Atmosphere
Loading post...
{ "uri": "at://did:plc:yogdrccs7zky4g6omnsfg2v5/app.bsky.feed.like/3lbw5552bdq2k", "cid": "bafyreidbfwg26vgfcae6sdl377ywlqjfdy26igm52w3l7gstuxihqnnoem", "value": { "$type": "app.bsky.feed.like", "subject": { "cid": "bafyreidvlzo7jycnefvlxx5mvply4lof5krn77llvodoee6jr7ijzyl7z4", "uri": "at://did:plc:3jwoo35wgmcievx5ahac3ach/app.bsky.feed.post/3lbuukbkbgs2s" }, "createdAt": "2024-11-27T08:30:11.220Z" } }
We dropped the Zamba2 and Zyda2 tech reports on arxiv! - Zamba2 models of size 1.2B, 2.7B, 7.4B - Zyda-2 5T token dataset - We discuss more specifics on model arch, training process, dataset creation, etc Links: - Zamba2: arxiv.org/abs/2411.15242 - Zyda-2: arxiv.org/abs/2411.06068
Nov 26, 2024, 8:23 PM