Github KoboldCPP

Github KoboldCPP is an easy-to-use, cross-platform local AI tool for text generation, multimodal tasks, and more, compatible with GGML and GGUF models. It offers local LLM inference, image and video generation, speech-to-text, text-to-speech, multimodal vision, and music generation, all in a single distributable with no installation required. KoboldCPP is aimed at users who want to run advanced AI models, including creative writers, developers, and researchers, on their own hardware with a flexible UI and broad model support.