mudler/locate-anything.cpp-gguf

object-detection model by mudler

From the publisher

Model card & documentation

Source preview

Read the publisher’s intended use, setup instructions, evaluations and limitations. The original model card is the source of truth.

GGUF builds of nvidia/LocateAnything-3B for locate-anything.cpp - a C++/ggml inference engine for open-vocabulary detection / visual grounding, no Python at inference time. Brought to you by the LocalAI team. The detections are the same as the official PyTorch implementation (the engine is parity-gated against it), and it runs faster - on CPU and GPU. The full-precision f32 GGUF (15 GB) is reproducible from the HF weights with scripts/convertlocateanythingtogguf.py in the repo. Same detections as the official model, faster. Full methodology, the warm/median setup, parity checks, and more images are in the repo's benchmarks/BENCHMARK.md. Slow-mode inference on the 448 fixture; vs official divides the official PyTorch f32 time (23.65 s) by each. Only the Qwen2 LM matmuls are quantized, so box parity is preserved through q6k: Run against the official model exactly as its model card documents (bf16), greedily, on one GB10 GPU. Precision-matched (our f16 vs its bf16) ours is…

mudler/locate-anything.cpp-gguf on Hugging Face A short preview, not the full document.

Read the full model card ↗ · Preview checked 2026-10-30T19:56:04.512Z

Inside the original model card — Document outline

Headings are captured from the source. Links open the publisher’s document, not a locally hosted copy.

Links from the model card

References supplied by the publisher, not independently verified endorsements. Check the destination before downloading files or entering credentials.

NVIDIA's license

Documentation belongs to its respective authors. Reported project/model license: other. A listing is not a grant of reuse or training rights. Confirm the document’s own terms at the source.

Model overview

mudler/locate-anything.cpp-gguf is a object-detection model repository published by mudler on Hugging Face. The source reports the gguf library.

This page summarizes Hub metadata. For intended use, training data, evaluation results and limitations, consult the original model card.

Model facts

Task: object-detection
Library: gguf
Recent downloads (30 days): 3,917,880
Cumulative likes: 73
Hugging Face trending score: 4
Reported safetensors parameters: Not reported
Architecture: Not reported
License: other
Access: Not gated by Hugging Face
Created: 2026-06-11T13:55:12.000Z
Last modified: 2026-06-11T22:46:02.000Z

Compatibility and lineage

Language coverage was not reported.

Reported base models: nvidia/LocateAnything-3B

Parameter count is not a RAM/VRAM requirement. Check precision, quantization, context length and runtime compatibility in the model card; no hardware or API-cost claim is inferred here.

Use and evaluate

Check license terms and access requirements first. Review the model card’s documented loading instructions, evaluations and safety limitations. Benchmark scores are not imported by this directory, and popularity is not an accuracy ranking.

No model weights are downloaded or executed by AltAPIs. Never enable remote model code without reviewing it.

Model card and usage instructions

Model files and configuration

Community discussion