incoai/splash
A local inference engine for Apple silicon, built around the model.
Older snapshot: check the original source for current information.
From the publisher
README & documentation
Source previewRead the project’s overview, installation instructions and usage examples. The original README is the source of truth.
[](https://github.com/incoai/splash/actions/workflows/ci.yml) [](LICENSE) [](#quick-start) A local inference engine for Apple silicon, built around the model. Splash runs coding agents and OpenAI or Anthropic compatible applications on one Mac. It combines DFlash 2 speculative decoding, specialized Metal kernels, and automatic memory planning, with vision, tool calling, and a built-in chat page. It reuses cached prefixes and batches concurrent requests automatically. Download the Splash desktop app for an Apple M3 or newer on macOS 26.4 or later, open the disk image and drag Splash into Applications. The command line needs the same Mac and Homebrew: The first run downloads the model and its matching draft and starts serving on 127.0.0.1:8000. Later starts reuse the downloads; leave room on disk for them (storage requirements). Once it prints Ready, leave this terminal open. Open in your browser, or run an installed coding agent from another terminal: For a server started with another --port, pass the…
Read the full README ↗ · Preview checked 2026-11-01T09:52:00.116Z
Inside the original README — Document outline
Headings are captured from the source. Links open the publisher’s document, not a locally hosted copy.
Links from the README
References supplied by the publisher, not independently verified endorsements. Check the destination before downloading files or entering credentials.
Documentation belongs to its respective authors. Reported project/model license: Apache-2.0. A listing is not a grant of reuse or training rights. Confirm the document’s own terms at the source.
What this repository does
A local inference engine for Apple silicon, built around the model.
Repository facts
- Owner
- incoai
- Primary language
- C++
- Stars
- 1,308
- Forks
- 118
- Open issues + pull requests
- 87
- License
- Apache-2.0
- Archived
- No
- Default branch
- main
- Created
- 2026-09-18T20:01:48.000Z
- Last push
- 2026-10-06T11:57:19.000Z
Topics and intended use
Owner-supplied topics: apple-silicon, coding-agents, llm-inference, macos, metal, speculative-decoding
Review the README for scope, installation, examples and limitations. We do not run repository code or certify it.
Evaluate before installing
Review licensing and dependencies, inspect recent commits and unresolved issues, and test in an isolated environment before production use. Stars and forks alone cannot answer these questions.
Source and freshness
Source: GitHub. Metadata observed 2026-10-09T12:07:53.309Z. Daily imports are snapshots, not real-time monitoring.
Popularity and source listings do not establish security, suitability, licensing rights or benchmark performance.