ollaya-dev/ollaya
1,311 80RustApache-2.0Updated 3 weeks ago
Run open decision models locally: pull and serve Laya, decider, NLI and GLiClass behind a TypeSafe-compatible API. Ollama for decision models.
calibrationclassificationdecision-modelsgliclassjevlayallm-routinglocal-inferencenliollamaonnxonnxruntimerusttypesafezero-shot-classification
Our verdict: worth borrowing ideas from
Ollaya allows running decision models locally with a TypeSafe-compatible API, which could provide valuable insights into decision-making processes.
Filed under llm serving in our directory.