Explore live open-source projects and AI models.

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

End-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model management, MCP servers, image generation, and TTS.

Local llama.cpp model hot-swap controller for preserving chat context with low VRAM overhead

Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends

🤵 AIfred-Intelligence — self-hosted Multi-Agent Assistant with Debate Modes (Symposion/Tribunal), Voice (STT + Streaming-TTS), RAG with Long-Term Memory, Web Research and Tool-Calling. Reachable via Web-UI or Telegram/Discord/Email/EPIM. Multi-Backend: llama-swap, Ollama, vLLM, TabbyAPI.

LLM Stack for nVidia DGX Spark containing LiteLLM, LamaSwap, vLLM, Llama.cpp and ollama

Dynamic LLM model swapping system with Docker, vLLM integration, and GPU acceleration. Supports GGUF & Hugging Face models with automatic swapping and Traefik routing.

Ollama-shape inference manager using Tom's TurboQuant llama.cpp. FIFO queue + grace + IDLE_HOT hot-hold + model swap on Blackwell.

Docker/podman container for llama.cpp/vllm/exllamav{2,3} orchestrated using llama-swap

Multi-LLM agent framework with Claude Code-like tools. Use DeepSeek, Claude, GPT, Llama, or any model — same tools, same skills, swap freely. Includes file editing, code search, shell execution, sub-agents, and a production-ready API. The missing SDK between your LLM and your codebase.