🐙 GitHub Detail
cool-japan/oxillama
By cool-japan
Pure Rust LLM Inference Engine — The Sovereign Alternative to llama.cpp License Rust Complete GGUF model loading, multi-format quantized inference, and an OpenAI-compatible API server — all without a single line of C, C++, or Fortran code.
Live Snapshot
⭐
Stars
16
🍴
Forks
4
📄
License
Apache License 2.0
🧩
Type
Rust
About this open-source project
Live information fetched from GitHub.
Pure Rust LLM Inference Engine — The Sovereign Alternative to llama.cpp License Rust Complete GGUF model loading, multi-format quantized inference, and an OpenAI-compatible API server — all without a single line of C, C++, or Fortran code.
Default Branch
master
Open Issues
0
Watchers
16