Ollama
Run large language models locally with a simple command-line interface and API.
Overview
Ollama lets you download and run open large language models locally on macOS, Windows, or Linux (or via an official Docker image), and exposes a REST API for chatting with or managing those models programmatically - useful for building applications that call a local model the same way they might call a hosted LLM API.
Beyond running models directly, Ollama can also launch and connect to external coding agents and assistants - including Claude Code, Codex, Copilot CLI, and OpenCode - and, through its OpenClaw integration, act as a personal AI assistant reachable from chat apps like WhatsApp, Telegram, Slack, and Discord.
Official client libraries are available for Python and JavaScript. Ollama is a fit for developers who want to run models on their own hardware for privacy, cost, or offline reasons, or who want a local runtime that can also plug into existing coding-agent and chat-based AI workflows.
- Categories
- AI & Machine Learning
- Languages
- Go
- License
- MIT
Related Projects
LangChain
MITFramework for developing applications powered by large language models, agents and retrieval-augmented generation.
- AI & Machine Learning
Milvus
Apache-2.0Open source vector database built for scalable similarity search and AI applications.
- AI & Machine Learning
- Database
PyTorch
BSD-3-ClauseOpen source machine learning framework that accelerates the path from research prototyping to production deployment.
- AI & Machine Learning
Qdrant
Apache-2.0Vector database and similarity search engine for building AI applications with embeddings.
- AI & Machine Learning
- Database
Spotted an error? Suggest an edit on GitHub.