A new compute-in-memory accelerator for small language models hits 400 tokens/s on LLaMA3.2-1B with 49x better energy efficiency than Jetson Orin Nano.
document fetched 2026-10-31 02:55
KAUST's EdgeCIM Hits 1,000 Tokens per Second Running AI on Edge Devices — retained record — High Signal