🐙 GitHub Detail
google-ai-edge/LiteRT-LM
By google-ai-edge
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
Live Snapshot
⭐
Stars
5,526
🍴
Forks
571
📄
License
Apache License 2.0
🧩
Type
C++
About this open-source project
Live information fetched from GitHub.
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
Default Branch
main
Open Issues
357
Watchers
5,526