← sources

Future use of local: compressed wikipedia

source: reddit (reddit:LocalLLaMA)published 2026-11-19 13:34ingested 2026-11-20 02:39

retained text

Neural networks will have the best compression ratio.  So we will be able to have wikipedia and other interesting sources like arxiv, compressed easily into our local setups.  Probably get a good amount in a modest phone setup to.  [https://tufalabs.ai/research/tufazip/](https://tufalabs.ai/research/tufazip/)

Only 27 gb to compress wikipedia text and have it local.  Generation speed remains an issue I suppose.

document fetched 2026-11-20 00:42 · canonical https://reddit.com/r/LocalLLaMA/comments/1y09hhp/future_use_of_local_compressed_wikipedia