Text Generation WebUI (oobabooga)

A Gradio-based interface for running local LLMs on Windows multiple backends, an OpenAI-compatible API, and full control over the model you load.