LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
📊 Project Info
- Language
- Python
- Stars
- ⭐ 15,910
- Forks
- 1,361
- Today
- +109
- Ranking
- #13
- Collection
- Language
- Trending Date
- June 4, 2026
- Last Push
- 6/4/2026
🏷️ Topics
apple-siliconinference-serverllmmacosmlxopenai-api
📸 Screenshots
