starryhoshi/Qwen3.5-4B-NekoCOT-GGUF

image-text-to-text model by starryhoshi

Open original source ↗

Older snapshot: check the original source for current information.

From the publisher

Model card & documentation

Source preview

Read the publisher’s intended use, setup instructions, evaluations and limitations. The original model card is the source of truth.

本仓库是 starryhoshi/Qwen3.5-4B-NekoCOT 的 合并后 GGUF 版:把 QLoRA 适配器合并进 unsloth/Qwen3.5-4B 基座权重后转换而来,面向 llama.cpp / Unsloth Studio / LM Studio 等本地推理场景。 模型输出为「先思考、再回复」两段式:… 里是猫娘视角的内心独白,之后才是正式回复。对话模板已内嵌在 GGUF 文件中,不需要额外配置。 合计约 3.46 GB。 两部分的分工: 调用示例: 启动时带了 --mmproj 的话,同一个接口也接受图像(把 换成图片的 base64 编码): Unsloth Studio 是训练这个模型的同一个桌面应用,内置 llama.cpp 推理引擎,可以直接加载本地 GGUF 文件对话: GGUF 推理由内置的 llama.cpp 提供,可在设置里的 Compute backend 切换 CUDA / Vulkan / CPU 等后端。 把两个 .gguf 文件放进 LM Studio 的模型目录(或直接拖入窗口),在模型列表里选择即可。对话模板随文件内嵌,会自动生效;要启用图像输入,在模型加载设置里把 mmproj /…

starryhoshi/Qwen3.5-4B-NekoCOT-GGUF on Hugging Face A short preview, not the full document.

Read the full model card ↗ · Preview checked 2026-11-14T12:58:21.636Z

Inside the original model card — Document outline
  1. Qwen3.5-4B-NekoCOT-GGUF
  2. 文件
  3. 快速开始
  4. llama.cpp
  5. Unsloth Studio
  6. LM Studio
  7. 采样参数
  8. 硬件参考
  9. 许可与署名
  10. 使用须知与局限
  11. 引用

Headings are captured from the source. Links open the publisher’s document, not a locally hosted copy.

Links from the model card

References supplied by the publisher, not independently verified endorsements. Check the destination before downloading files or entering credentials.

Documentation belongs to its respective authors. Reported project/model license: cc-by-nc-4.0. A listing is not a grant of reuse or training rights. Confirm the document’s own terms at the source.

Model overview

starryhoshi/Qwen3.5-4B-NekoCOT-GGUF is a image-text-to-text model repository published by starryhoshi on Hugging Face. The source reports the gguf library.

This page summarizes Hub metadata. For intended use, training data, evaluation results and limitations, consult the original model card.

Model facts

Task
image-text-to-text
Library
gguf
Recent downloads (30 days)
0
Cumulative likes
0
Hugging Face trending score
0
Reported safetensors parameters
Not reported
Architecture
Not reported
License
cc-by-nc-4.0
Access
Not gated by Hugging Face
Created
2026-10-04T06:23:36.000Z
Last modified
2026-10-04T06:38:37.000Z

Compatibility and lineage

Reported languages: zh, en

Reported base models: unsloth/Qwen3.5-4B, starryhoshi/Qwen3.5-4B-NekoCOT

Parameter count is not a RAM/VRAM requirement. Check precision, quantization, context length and runtime compatibility in the model card; no hardware or API-cost claim is inferred here.

Use and evaluate

Check license terms and access requirements first. Review the model card’s documented loading instructions, evaluations and safety limitations. Benchmark scores are not imported by this directory, and popularity is not an accuracy ranking.

No model weights are downloaded or executed by AltAPIs. Never enable remote model code without reviewing it.

Model card and usage instructions

Model files and configuration

Community discussion

Source and freshness

Source: Hugging Face Hub. Metadata observed 2026-10-04T06:39:42.784Z. Daily imports are snapshots, not real-time monitoring.

Popularity and source listings do not establish security, suitability, licensing rights or benchmark performance.

Open original source

Related models

microsoft/Florence-2-base

ISTA-DASLab/Qwen3.8-Flash-Next-GSQ-RCO-GGUF

Qwen/Qwen3.8-27B

Qwen/Qwen3-VL-8B-Instruct

zai-org/GLM-5.3-Flash

google/gemma-4-31B-it