You can run agentty entirely offline against a local Ollama model — no cloud, no API keys, nothing leaves your machine. Here's how.
1. Install Ollama and pull a model
# install ollama (see ollama.com), then pull a coding-capable model
ollama pull qwen2.5-coder:7b2. Install agentty
curl -fsSL https://agentty.org/install.sh | sh3. Point agentty at Ollama
Configure the Ollama provider (host defaults to http://localhost:11434) and select your pulled model. agentty streams tokens from the local server exactly as it would from a cloud provider.
4. Code offline
Run agentty in your project. Because retrieval (RAG) is built in and runs locally too, only the relevant slices of your repo are fed to the model — which keeps local models fast and within their context window.
Why local?
- Privacy — source code never leaves your machine.
- No cost — no per-token billing.
- Offline — works on a plane or an air-gapped network.
Tips
- Smaller models (7B) are fast; use agentty's Smart Mode to reserve a bigger local model for the hard steps.
- A GPU helps a lot for latency, but CPU-only works for smaller models.
See the providers docs for full configuration.