LLM inference in C/C++
Project homepage
Our verdict: worth keeping an eye on
ollama wraps it. Both blocked on the same missing use case.
Filed under llm serving in our directory.