Explore live open-source projects and AI models.

🎨 The exhaustive Pattern Matching library for TypeScript, with smart type inference.

Nano vLLM

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference exe... Read more

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

DeepSeek 4 Flash local inference engine for Metal and CUDA

Open source alternative to AWS. Elastic compute, block storage (non replicated), firewall and load balancer, managed Postgres, K8s, AI inference, and IAM services.

Spark-TTS Inference Code

Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.

Large Language Model Text Generation Inference

Official inference library for Mistral models