My local model is fine until I ask it to do something
retained text
I've been running local AI on my acemagic f5a for a bit, a normal mini pc. Mostly chat and document summaries first. Then I gave it a few boring jobs I really didn't want to do myself. Sorting folders, extracting information from piles of documents, making API calls to pull in some data. And wow, agents can be frustrating. A model can give me a perfectly decent answer in chat, then completely lose the plot when it's supposed to carry out a few steps. One API call fails, it carries on with the next step using incomplete data. Sometimes it even tells me the job is done. Open the folder and... nope, half the files are still there. I used to think I just needed a smarter model. Now I'm less sure. The tool setup, state tracking and error handling seem to matter a lot too. If the agent doesn't know a step failed, even a good model can end up producing rubbish. I'm only trying to automate small personal tasks here, nothing particularly ambitious. Still, I spend quite a bit of time checking its work. is this just part of the experience?
document fetched 2026-11-20 00:19 · canonical https://reddit.com/r/AI_Agents/comments/1y089ak/my_local_model_is_fine_until_i_ask_it_to_do