JustVugg/colibri
41,904 4,638CApache-2.0Updated 2 weeks ago
Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
Our verdict: worth borrowing ideas from
This repo offers a lightweight engine for running large models on existing hardware, which could provide valuable insights or components for local AI work.
Filed under llm serving in our directory.