Experimental browser for the Atmosphere
Before releasing Talk Arena, we collected votes from over 350 paid participants on Prolific comparing five popular models’ text responses. The initial standings show 🏅DiVA, 🥈GPT4o, 🥉Gemini, 4️⃣ Qwen2 Audio, 5️⃣ Typhoon. (2/5)
Dec 10, 2024, 12:01 AM
{
"text": "Before releasing Talk Arena, we collected votes from over 350 paid participants on Prolific comparing five popular models’ text responses. \n\nThe initial standings show 🏅DiVA, 🥈GPT4o, 🥉Gemini, 4️⃣ Qwen2 Audio, 5️⃣ Typhoon. (2/5)",
"$type": "app.bsky.feed.post",
"embed": {
"$type": "app.bsky.embed.images",
"images": [
{
"alt": "Screenshot of the following table\n\n| Model | Bradley Terry Score | Open-Sourced? | Site |\n|:-------------|:--------------------:|:-------------:|:-----:|\n| 🏅DiVA | 36.0 | ✅ | [🔗](https://huggingface.co/WillHeld/DiVA-llama-3-v0-8b) |\n| 🥈GPT4o | 24.2 | ❌ | [🔗](https://platform.openai.com/docs/guides/audio) |\n| 🥉Gemini | 21.7 | ❌ | [🔗](https://deepmind.google/technologies/gemini/pro/) |\n| 4️⃣ Qwen2 Audio | 14.5 | ✅ | [🔗](https://github.com/QwenLM/Qwen2-Audio) |\n| 5️⃣ Typhoon | 3.6 | ✅ | [🔗](https://huggingface.co/scb10x/llama-3-typhoon-v1.5-8b-audio-preview) |",
"image": {
"$type": "blob",
"ref": {
"$link": "bafkreif6i6vscjd4fe4mpotoqraaaq22orxc7tcezpqs6v6mtmrzc4xvaq"
},
"mimeType": "image/jpeg",
"size": 76243
},
"aspectRatio": {
"width": 624,
"height": 287
}
}
]
},
"langs": [
"en"
],
"reply": {
"root": {
"cid": "bafyreidefh3jrhtu6xfxyo5nh7ttbnzvx5yi4z2iqxbktmdk4rx74lxc44",
"uri": "at://did:plc:exj4ro3xzv7id2hstt5ys5j5/app.bsky.feed.post/3lcvwrmffzc2p"
},
"parent": {
"cid": "bafyreidefh3jrhtu6xfxyo5nh7ttbnzvx5yi4z2iqxbktmdk4rx74lxc44",
"uri": "at://did:plc:exj4ro3xzv7id2hstt5ys5j5/app.bsky.feed.post/3lcvwrmffzc2p"
}
},
"createdAt": "2024-12-10T00:01:34.081Z"
}