← sources

FineDNA: the largest dataset to teach any LLM DNA (midtraining, SFT, RL)

source: reddit (reddit:LocalLLaMA)published 2026-11-01 07:24ingested 2026-11-02 02:41

retained text

Hi everyone, we're releasing FineDNA, all the data we used to turn Qwen3-14B into Carbon-X, the strongest open language model on DNA. It contains:

* Midtraining: 300B+ tokens of genomes and DNA-rich text
* SFT: \~200K conversations
* RL: \~98K verifiable prompts

Code and recipe are open too, so you can apply it to other LLMs.

Dataset: [https://huggingface.co/datasets/HuggingFaceBio/FineDNA](https://huggingface.co/datasets/HuggingFaceBio/FineDNA)  
Code: [https://github.com/huggingface/carbon](https://github.com/huggingface/carbon)

document fetched 2026-11-02 00:37 · canonical https://reddit.com/r/LocalLLaMA/comments/1xkwvwg/finedna_the_largest_dataset_to_teach_any_llm_dna