featherless-ai/simple-jev
374 38PythonUpdated 1 month ago
Turn any open model into a classifier/jev endpoint
Our verdict: worth borrowing ideas from
Implements a self‑hosted inference server that reads LLM logits to produce structured JSON classifications, a reusable pattern for his own FastAPI classifier services
Filed under llm serving in our directory.