← sources

Is there a way to make LLM usage free for small businesses? πŸ€”

source: reddit (reddit:LocalLLaMA)published 2026-10-22 15:00ingested 2026-10-23 02:42

retained text

I've been wondering… small businesses usually have a few employees, each with their own work laptop with a decent amount of computing power.

Could we pool the Ollama/Lemonade clients running on employees' work laptops together to share the inference workload?

Of course, employees might shut down their laptops or take them home. But I think it's an interesting idea worth exploring.

I'm thinking about running a small experiment with local businesses to see if this idea has any legs.

I've put together a minimal prototype that connects PCs running Ollama or Lemonade through a shared API, using a custom load balancer. If anyone's interested in checking out the source code, here's the GitHub repo: [https://github.com/JY-Quek/FreeLLM](https://github.com/JY-Quek/FreeLLM)

So, what do you think? Is this a terrible idea, an interesting experiment, or potentially another way to make AI more accessible to everyone?

Feel free to poke holes in the idea. I'd rather hear about the problems now than discover them the expensive way later! πŸ˜‚

document fetched 2026-10-23 00:46 Β· canonical https://reddit.com/r/LocalLLaMA/comments/1xckxto/is_there_a_way_to_make_llm_usage_free_for_small