Self-Hosting Tools
- Jan - Self-Hosted /
https://discord.com/invite/FTk2MvZwJH
/
https://github.com/janhq/jan - SillyTavern - Self-Hosted Interface /
https://discord.gg/sillytavern
/
https://www.reddit.com/r/SillyTavernAI/
/
https://github.com/SillyTavern/SillyTavern - Open WebUI - Self-Hosted Interface /
https://discord.gg/5rJgQTnV4s
/
https://github.com/open-webui/open-webui - llama.cpp - Self-Host Transformer-Based LLMs / Guide
- KoboldCpp - llama.cpp with API + GUI / rocM / Colab
- Pinokio - Single Click AI Model Installer /
https://discord.gg/TQdNwadtE4
/
https://github.com/pinokiocomputer/pinokio - oobabooga - Self-Host Models / Colab /
https://www.reddit.com/r/Oobabooga/
/
https://discord.gg/jwZCF2dPQN - Aphrodite Engine - Serve LLMs at Scale with Kobold & OpenAI APIs / Colab /
https://github.com/PygmalionAI/aphrodite-engine - Petals - Self-Hosted /
https://discord.gg/D9MwApKgWa
/
https://github.com/bigscience-workshop/petals - Ollama - Self-Hosted /
https://discord.com/invite/ollama
/
https://github.com/ollama/ollama - LM Studio - Self-Hosted /
https://discord.gg/aPQfnNkxGC
/
https://github.com/lmstudio-ai - AnythingLLM - Self-Hosted
- LibreChat - Self-Hosted /
https://discord.com/invite/CEe6vDg9Ky
/
https://github.com/danny-avila/LibreChat - GPT4All - Self-Hosted /
https://github.com/nomic-ai/gpt4all
/
https://discord.com/invite/myY5YDR8z8 - llamafile - Run LLM with Single Files /
https://discord.gg/YuMNeuKStr - Generative AI for Beginners - Generative AI Guides
