featherless-ai/simple-jev
Turn any open model into a classifier/jev endpoint
From the publisher
README & documentation
Source previewRead the project’s overview, installation instructions and usage examples. The original README is the source of truth.
Use compatible open models from huggingface, for structured classification and scoring, without training a separate classifier head. Explore the demos, playground, and documentation at simple-jev.featherless.ai. Send shared context and a set of questions. Simple Jev reads the model's next-token logits for each question and builds a JSON response containing choices, rubric scores, or truth/support judgments. The model does not generate a JSON completion: the server constructs the response from the scores. The current implementation runs locally with Hugging Face Transformers and PyTorch. Shared request validation, versioned prompt instructions, and response scoring live in the plain Python common/ folder so other inference implementations can use the same rules. Try the public demo API with no login, API key, or authentication required. The demo has a 2k-token context limit and is rate limited to 2 requests per second (2 RPS). First, list the available models with GET /v1/models: The demo already serves…
Read the full README ↗ · Preview checked 2026-09-20T07:37:41.970Z
Inside the original README — Document outline
- Simple Jev Project
- Try it today
- Running the HF Server
- How do I use the API?
- What is a classifier, and why “System One”?
- How shared prompts and prefill-only scoring reduce work
- Shared prompt contract and project layout
- Testing
- One more thing: Really Fancy Decision Training (RFDT)
Headings are captured from the source. Links open the publisher’s document, not a locally hosted copy.
Links from the README
References supplied by the publisher, not independently verified endorsements. Check the destination before downloading files or entering credentials.
Documentation belongs to its respective authors. Reported project/model license: Apache-2.0. A listing is not a grant of reuse or training rights. Confirm the document’s own terms at the source.
What this repository does
Turn any open model into a classifier/jev endpoint
Repository facts
- Owner
- featherless-ai
- Primary language
- Python
- Stars
- 417
- Forks
- 44
- Open issues + pull requests
- 1
- License
- Apache-2.0
- Archived
- No
- Default branch
- main
- Created
- 2026-09-18T09:52:15.000Z
- Last push
- 2026-09-21T06:25:47.000Z
Topics and intended use
No topics were included in the latest source metadata.
Review the README for scope, installation, examples and limitations. We do not run repository code or certify it.
Evaluate before installing
Review licensing and dependencies, inspect recent commits and unresolved issues, and test in an isolated environment before production use. Stars and forks alone cannot answer these questions.
Source and freshness
Source: GitHub. Metadata observed 2026-09-21T06:41:42.808Z. Daily imports are snapshots, not real-time monitoring.
Popularity and source listings do not establish security, suitability, licensing rights or benchmark performance.
Related repositories
EbookFoundation/free-programming-books
donnemartin/system-design-primer