Experimental browser for the Atmosphere
2. OpenAI’s best practices for finetuning While this guide focuses on GPT-3, many techniques are applicable to finetuning in general. It explains how finetuning works, how to prepare training data, how to pick hyperparameters, and common finetuning mistakes: docs.google.com/document/d/1...
Dec 13, 2024, 4:05 AM
{ "uri": "at://did:plc:xdnifsedajxdcxn7wui6nxev/app.bsky.feed.post/3ld5vtbsmac2w", "cid": "bafyreiblv2cobwod6p2bpne4tr2d3mpvorh626t3ecf3tvurihcoiklfam", "value": { "text": "2. OpenAI’s best practices for finetuning\n\nWhile this guide focuses on GPT-3, many techniques are applicable to finetuning in general. It explains how finetuning works, how to prepare training data, how to pick hyperparameters, and common finetuning mistakes: docs.google.com/document/d/1...", "$type": "app.bsky.feed.post", "embed": { "$type": "app.bsky.embed.external", "external": { "uri": "https://docs.google.com/document/d/1rqj7dkuvl7Byd5KQPUJRxc19BJt8wo0yHNwK84KfU3Q/edit", "thumb": { "$type": "blob", "ref": { "$link": "bafkreien77jw2kqehtkhmj3r4dkbvgxunwgwsyccyuyix3wdw73mb4eney" }, "mimeType": "image/jpeg", "size": 608912 }, "title": "[PUBLIC] Best practices for fine-tuning GPT-3 to classify text", "description": "This document is a draft of a guide that will be added to a future revision of the OpenAI documentation. If you have any feedback, feel free to let us know. One note: this doc shares metrics for text..." } }, "langs": [ "en" ], "reply": { "root": { "cid": "bafyreiboicjtmoshf6b7i536sckhbylx3qronji5udz5woj3nwoqne76dy", "uri": "at://did:plc:xdnifsedajxdcxn7wui6nxev/app.bsky.feed.post/3ld5vjdpcwk2w" }, "parent": { "cid": "bafyreihso6r3ceasp2jhfpi72oczhbesjnjpoxtmdngcq7tolnngxgzw6q", "uri": "at://did:plc:xdnifsedajxdcxn7wui6nxev/app.bsky.feed.post/3ld5vtasa422w" } }, "facets": [ { "index": { "byteEnd": 293, "byteStart": 262 }, "features": [ { "uri": "https://docs.google.com/document/d/1rqj7dkuvl7Byd5KQPUJRxc19BJt8wo0yHNwK84KfU3Q/edit", "$type": "app.bsky.richtext.facet#link" } ] } ], "createdAt": "2024-12-13T04:05:53.194Z" } }