LiteLLM open-sources a self-hosted agent builder for Claude Code, Hermes & more
LiteLLM has released an open-source platform for building and running AI agents on your own server. It connects with tools like Claude Code, Hermes, and OpenCode, and works with local models via Ollama or vLLM — no paid API required. This gives developers a cost-effective, private alternative to hosted agent services.
LiteLLM is best known as a library that lets you call many AI models through one consistent interface. Its new Agent Platform builds on that foundation, letting you wire together multiple AI tools into automated workflows — all running on hardware you control. Because you host it yourself, you avoid per-seat subscription fees, and by pointing it at local models through Ollama or vLLM you can cut API costs to near zero. Popular coding assistants like Claude Code and Hermes-Agent can be plugged directly into these workflows, which is immediately practical for anyone already using those tools. For solo builders or small teams running on a Mac mini or a cheap VPS, this lowers the barrier to running serious multi-step AI pipelines significantly.
Key points
- Fully open-source — install and run on your own machine or server for free
- Connects out of the box with Claude Code, Hermes, and OpenCode
- Supports Ollama and vLLM so you can run local models and avoid API fees
- Data stays on your own hardware, which improves privacy
- Built on LiteLLM's multi-model layer, making it easy to swap models
Quick term guide
- open-source
- Software whose code is shared publicly so others can inspect, use, or change it.
- AI agents
- AI agents are AI tools that can carry out steps toward a goal, not just answer once.
- local model
- An AI model you run directly on your own computer, with no internet connection or external service needed.
- developers
- Developers are people who build software, apps, or websites.
- AI models
- The core brain or underlying program that powers an artificial intelligence tool.
- Interface
- The visual parts of a program that a human interacts with.
- subscription
- A pricing model where you pay a fixed amount of money every month for access.
- hermes-agent
- A likely name for Nous Research’s agent-style AI tool or service.
Sources covering this story (3)
- r/AI_AgentsLiteLLM open-sources a self-hosted agent builder for Claude Code, Hermes & more ↗
- r/ollamaWe are open-sourcing LiteLLM Agent Platform: a self-hosted OSS agent builder for Hermes, OpenCode, Claude Code (bring your own models, Ollama work) ↗
- r/aiworkflowsOpen-source AI workflow: browser chat manages local Claude Code sessions ↗