← sources

common : add --spec-draft-n-ubatch by ggerganov · Pull Request #30459 · ggml-org/llama.cpp

source: reddit (reddit:LocalLLaMA)published 2026-10-14 11:08ingested 2026-10-15 02:42

retained text

a new option to optimize your VRAM

document fetched 2026-10-15 00:46 · canonical https://reddit.com/r/LocalLLaMA/comments/1x5odh2/common_add_specdraftnubatch_by_ggerganov_pull