Ollama
by Ollama
Ollama lets you download and run large language models like Llama 3, Mistral, Phi, and Gemma directly on your computer. No cloud, no API costs, full privacy. One command to install, one command to run. The REST API is OpenAI-compatible so any client just works.
Free