PrismML-Eng/Bonsai-demo
Bonsai Demo
From the publisher
README & documentation
Source previewRead the project’s overview, installation instructions and usage examples. The original README is the source of truth.
Backend and model format compatibility: BACKEND-SUPPORT.md. Website | GitHub | Discord Models: Bonsai 2 27B GGUF · Bonsai 2 27B MLX Run Bonsai 2 27B locally on Mac (Metal), Linux/Windows (CUDA, Vulkan, ROCm), or CPU. For the earlier Bonsai 1-bit and Ternary-Bonsai models (27B, 8B, 4B, 1.7B), see Bonsai1README.md. For troubleshooting, see FAQ.md. Bonsai 2 27B is this demo's default. Full 27B-class reasoning in ternary weights, at 5.9 GB, running on a laptop or a single GPU. intact: math within half a point of full precision, coding level with the baseline. (see VISION.md). in both demo UIs (see TOOLS.md). faster prompt processing and is what this demo downloads by default. See MODEL-FORMATS.md. Bonsai 2 needs this demo's llama.cpp binaries, from the PrismML fork; stock llama.cpp cannot run these files. ./setup.sh fetches the right ones for your machine. Quick Start below gets you there in two commands: ./setup.sh downloads Bonsai 2…
Read the full README ↗ · Preview checked 2026-09-29T14:00:11.126Z
Inside the original README — Document outline
- Bonsai Demo
- 🌱 New: Bonsai 2 27B
- Best Practices (Bonsai 2 27B)
- Generation Parameters
- System Prompt
- Quick Start
- macOS / Linux
- Windows (PowerShell)
- Speed Benchmarks
- Models
- Bonsai 2 (ternary, default)
- Environment variables
Headings are captured from the source. Links open the publisher’s document, not a locally hosted copy.
Links from the README
References supplied by the publisher, not independently verified endorsements. Check the destination before downloading files or entering credentials.
Documentation belongs to its respective authors. Reported project/model license: Apache-2.0. A listing is not a grant of reuse or training rights. Confirm the document’s own terms at the source.
What this repository does
Bonsai Demo
Repository facts
- Owner
- PrismML-Eng
- Primary language
- Shell
- Stars
- 3,194
- Forks
- 347
- Open issues + pull requests
- 21
- License
- Apache-2.0
- Archived
- No
- Default branch
- main
- Created
- 2026-03-25T19:25:09.000Z
- Last push
- 2026-09-28T17:40:24.000Z
Topics and intended use
Owner-supplied topics: bonsai, llamacpp, llm, mlx, prism-ml, small-models
Review the README for scope, installation, examples and limitations. We do not run repository code or certify it.
Evaluate before installing
Review licensing and dependencies, inspect recent commits and unresolved issues, and test in an isolated environment before production use. Stars and forks alone cannot answer these questions.
Source and freshness
Source: GitHub. Metadata observed 2026-09-29T12:03:10.583Z. Daily imports are snapshots, not real-time monitoring.
Popularity and source listings do not establish security, suitability, licensing rights or benchmark performance.