Explore live open-source projects and AI models.

Inference Llama 2 in one file of pure C

AirLLM 70B inference with single 4GB GPU

The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services

High-performance In-browser LLM Inference Engine

Machine Learning Engineering Open Book

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

Inference code for CodeLlama models

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.