← sources

Looking for a budget gpu fro llms

source: reddit (reddit:LocalLLaMA)published 2026-09-20 04:11ingested 2026-09-21 02:38

retained text

So I’ve got a budget of around 200 Aussie bucks (close to 140 american)

For a graphics card

My current rig

8gb  ddr4 2133 MHz vl 22

Asus x99 ws ipmi

Rx 480 8gb

256 gb sata ssd

Cooler master haf x

E5 2682 v4 

So what sizes would I like to run? 4b-27b (I know but unrealistic)

I’m running arch Linux 

I’d do a bit of merging and fine tunes and quants 

Ideally I want unsloth support

And it will run In a Hermes’ agent harness

My options are rather limited

I don’t have rebar but I do have above 4g decoding

Apparently there is some wizardry I can do to unlock rebar on my board

I have 5 pcie x16 slots it that helps

I’d like it to be a blower card also

So Intel arc is out the window 

What does that leave me?

document fetched 2026-09-21 00:37 · canonical https://reddit.com/r/LocalLLaMA/comments/1wl6qsj/looking_for_a_budget_gpu_fro_llms