# FineDNA: the largest dataset to teach any LLM DNA (midtraining, SFT, RL) — retained record

> Retained reddit record from reddit:LocalLLaMA.

Canonical: https://highsignal.app/data/records/a0083a8ebd97c493

[← sources](https://highsignal.app/data)


source: [reddit](https://highsignal.app/data/reddit) (reddit:LocalLLaMA)  published 2026-11-01 07:24 ingested 2026-11-02 02:41

[original source ↗](https://www.reddit.com/r/LocalLLaMA/comments/1xkwvwg/finedna_the_largest_dataset_to_teach_any_llm_dna/)

## retained text



```
Hi everyone, we're releasing FineDNA, all the data we used to turn Qwen3-14B into Carbon-X, the strongest open language model on DNA. It contains:

* Midtraining: 300B+ tokens of genomes and DNA-rich text
* SFT: \~200K conversations
* RL: \~98K verifiable prompts

Code and recipe are open too, so you can apply it to other LLMs.

Dataset: [https://huggingface.co/datasets/HuggingFaceBio/FineDNA](https://huggingface.co/datasets/HuggingFaceBio/FineDNA)  
Code: [https://github.com/huggingface/carbon](https://github.com/huggingface/carbon)


```



document fetched 2026-11-02 00:37 · canonical https://reddit.com/r/LocalLLaMA/comments/1xkwvwg/finedna_the_largest_dataset_to_teach_any_llm_dna
