← sources

dev.to: Three Gemma 4 Deployments on One T4G for Under $3: What the Runtime Changes, and What It Doesn't

source: dev-ecosystems (dev-ecosystems:devto)published 2026-09-01 18:25ingested 2026-09-03 02:33

retained text

vLLM, JAX and PyTorch serving the same Gemma 4 E2B checkpoint on the same AWS G5g GPU, on one harness and one statistic. The decode ranking reverses on boot time. Nineteen instances, four and a half instance-hours, under $3 - which is what let five wrong claims get caught.

tags: aws, machinelearning, benchmarking, python

reactions=7 | comments=1

document fetched 2026-09-07 07:11