text-generation-webui
Verified
The Swiss Army knife of local AI — Gradio interface supporting every model format and backend.
About text-generation-webui
text-generation-webui (by oobabooga) is a comprehensive Gradio-based web UI for running local LLMs. It supports virtually every model format (GGUF, GPTQ, AWQ, EXL2) and backend (llama.cpp, ExLlamaV2, Transformers). The most flexible tool for power users who want maximum control.
Key Features
- Supports every model format and backend
- Gradio web interface
- Extensions system (RAG, TTS, vision)
- LoRA loading and training
- API server for programmatic access
Pros & Cons
Pros
+ Maximum flexibility and format support
+ Rich extension ecosystem
+ Great for model experimentation
Cons
- Complex setup process
- Can be unstable with updates
- Steep learning curve
Use Cases
Testing different model formatsLoRA fine-tuning and mergingAdvanced local AI workflowsResearch and experimentation
Pricing
Open source
Free and open-source. AGPL license.
Who It's For
ML engineersAI researchersPower usersModel fine-tuners
Details
More in Local & Open Source AI