🐙 GitHub Detail
xorbitsai/inference
By xorbitsai
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
Live Snapshot
⭐
Stars
9,339
🍴
Forks
832
📄
License
Apache License 2.0
🧩
Type
Python
About this open-source project
Live information fetched from GitHub.
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
Default Branch
main
Open Issues
55
Watchers
9,339