Ollama
by Ollama
Ollama lets you download and run large language models like Llama 3, Mistral, Phi, and Gemma directly on your computer. No cloud, no API costs, full privacy. One command to install, one command to run. The REST API is OpenAI-compatible so any client just works.
Free
LM Studio
by LM Studio
LM Studio gives you a polished desktop app for discovering, downloading, and running open-source LLMs locally. Unlike Ollama (terminal-first), LM Studio has a full chat UI and model browser built in. Download from Hugging Face, chat directly in the app, and expose a local OpenAI-compatible API for your tools.
Free