🌍 Live Open Source Explorer
Explore live open-source projects and AI models.
Search public open-source repositories from GitHub and AI models from Hugging Face. Every page shows 10 results with clean pagination.
🔎 Live Search
Search live open-source data
Search GitHub repositories and Hugging Face models directly, then explore stars, downloads, source links and project details.
Live Results
GitHub Open Source Repositories
Search: mini-infer
Page 1
Showing 5 results from 5
psmarter/mini-infer
GitHub Python MIT LicenseLLM inference engine from scratch — paged KV cache, continuous batching, chunked prefill, prefix caching, speculative decoding, CUDA graph, tensor parallelism, OpenAI-compatible serving
External source
GitHub
Azure-Samples/Phi-3MiniSamples
GitHub C++ MIT LicenseDiscover how phi3-mini, a new series of models from Microsoft, enables deployment of Large Language Models (LLMs) on edge devices and IoT devices. Learn how to use Semantic Kernel, Ollama/LlamaEdge, and ONNX Runtime to access and infer phi3-mini models, and explore the possibilities of generative... Read more
External source
GitHub
GPT-SoVITS-Devel/GPT-SoVITS_minimal_inference
GitHub Python Apache License 2.0GPT-SoVITS的最小推理实现,onnx优化,支持tensorrt推理,原生性能. 带openai api兼容api.
External source
GitHub
ibaiGorordo/dust3r-pytorch-inference-minimal
GitHub Python OtherMinimal code for running the Dust3r model with PyTorch
External source
GitHub
michaelballantyne/miniKanren-occurrence-type-inferencer
GitHub SchemeNo description available from source.
External source
GitHub