Explore live open-source projects and AI models.

A very simple GRPO implement for reproducing r1-like LLM thinking.

AI-Powered Data Processing: Use LOTUS to process all of your datasets with LLMs and embeddings. Enjoy up to 1000x speedups with fast, accurate query processing, that's as simple as writing Pandas code

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

A simple tool to select files from a repository to copy/paste into an LLM

Checkpoint-engine is a simple middleware to update model weights in LLM inference engines

A simple, locally hosted Web Search MCP server for use with Local LLMs

[ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.

A simple and effective LLM pruning approach.

LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS.

MCP server for semantic code research and context generation on real-time using LLM patterns | Search naturally across public & private repos based on your permissions | Transform any accessible codebase/s into AI-optimized knowledge on simple and complex flows | Find real implementations and liv... Read more