← sources

If one f16 token on Qwen3.8 is 64KB what exactly is stored inside that tokens memory?

source: reddit (reddit:LocalLLaMA)published 2026-10-24 08:46ingested 2026-10-24 11:01

retained text

I believe I read 1 token is about half an English word. That is a few bytes at most. So what is the rest of a token memory actually used for?

document fetched 2026-10-25 00:36 · canonical https://reddit.com/r/LocalLLaMA/comments/1xe3k7b/if_one_f16_token_on_qwen38_is_64kb_what_exactly