PrismML-Eng/Bonsai-demo
Bonsai Demo
Older snapshot: check the original source for current information.
From the publisher
README & documentation
Source previewRead the project’s overview, installation instructions and usage examples. The original README is the source of truth.
Backend and model format compatibility: BACKEND-SUPPORT.md. Website | GitHub | Discord Models: Bonsai 2 27B GGUF · Bonsai 2 27B MLX Run Bonsai 2 2B, 4B, 9B, and 27B locally on Mac (Metal), Linux/Windows (CUDA, Vulkan, ROCm), or CPU. For the earlier Bonsai 1-bit and Ternary-Bonsai models (27B, 8B, 4B, 1.7B), see Bonsai1README.md. For troubleshooting, see FAQ.md. Bonsai 2 now includes 2B, 4B, and 9B models alongside 27B. Pick a smaller model for a lighter local setup; 27B remains the demo's default. GGUF and MLX checkpoints are available for each size. The following benchmark and memory highlights describe 27B; see each smaller model's card for its specifications: intact: math within half a point of full precision, coding level with the baseline. (see VISION.md). in both demo UIs (see TOOLS.md). faster prompt processing and is what this demo downloads by default. See MODEL-FORMATS.md. Official Q20 works with upstream llama.cpp b11556 or…
Read the full README ↗ · Preview checked 2026-11-11T01:00:39.762Z
Inside the original README — Document outline
- Bonsai Demo
- 🌱 Bonsai 2: 2B, 4B, 9B, and 27B
- Choose a smaller model
- Best Practices (Bonsai 2 27B)
- Generation Parameters
- System Prompt
- Quick Start
- macOS / Linux
- Windows (PowerShell)
- Speed Benchmarks
- Models
- Bonsai 2 (ternary, default)
Headings are captured from the source. Links open the publisher’s document, not a locally hosted copy.
Links from the README
References supplied by the publisher, not independently verified endorsements. Check the destination before downloading files or entering credentials.
Documentation belongs to its respective authors. Reported project/model license: Apache-2.0. A listing is not a grant of reuse or training rights. Confirm the document’s own terms at the source.
What this repository does
Bonsai Demo
Repository facts
- Owner
- PrismML-Eng
- Primary language
- Shell
- Stars
- 3,194
- Forks
- 347
- Open issues + pull requests
- 21
- License
- Apache-2.0
- Archived
- No
- Default branch
- main
- Created
- 2026-03-25T19:25:09.000Z
- Last push
- 2026-09-28T17:40:24.000Z
Topics and intended use
Owner-supplied topics: bonsai, llamacpp, llm, mlx, prism-ml, small-models
Review the README for scope, installation, examples and limitations. We do not run repository code or certify it.
Evaluate before installing
Review licensing and dependencies, inspect recent commits and unresolved issues, and test in an isolated environment before production use. Stars and forks alone cannot answer these questions.
Source and freshness
Source: GitHub. Metadata observed 2026-09-29T12:03:10.583Z. Daily imports are snapshots, not real-time monitoring.
Popularity and source listings do not establish security, suitability, licensing rights or benchmark performance.