Local & Open Source AI Tools

Run AI models locally on your hardware. Privacy-first, offline-capable, open-source tools for self-hosted inference.

Ollama

The easiest way to run open models locally and serve them through a developer-friendly API.

Local & Open Source AI
Freemium
4.7

llama.cpp

The C/C++ engine powering local AI — lightning-fast inference that Ollama and LM Studio build on.

Local & Open Source AI
Open source
4.5

LM Studio

Desktop app for discovering, running, chatting with, and serving local AI models.

Local & Open Source AI
Freemium
4.5

Llamafile

Single-file portable local LLM — download and run anywhere

Local & Open Source AI
Open source
4.4

Open WebUI

Self-hosted AI interface for Ollama, OpenAI-compatible APIs, tools, RAG, and teams.

Local & Open Source AI
Open source
4.4

vLLM

High-throughput LLM serving engine — the production standard for GPU inference at scale.

Local & Open Source AI
Open source
4.3

Jan

Open-source ChatGPT alternative that runs 100% offline on your computer.

Local & Open Source AI
Open source
4.2

GPT4All

Free, local, privacy-aware AI — run chatbots on consumer hardware with no GPU required.

Local & Open Source AI
Open source
4.1

TextGen

Open-source web UI for running, testing, and serving local language models.

Local & Open Source AI
Open source
4.1

LocalAI

Self-hosted OpenAI-compatible API — drop-in replacement for cloud AI in your infrastructure.

Local & Open Source AI
Open source
4.0

KoboldAI

Open local AI writing and roleplay ecosystem centered on KoboldCpp and KoboldAI Lite.

Local & Open Source AI
Open source
3.9

111 of 11 tools