prabanta-dev/Qwen3-0.6B-JNS

Qwen3-0.6B for Janas-LLM

On a laptop running Debian 13 Linux, with an Intel Core Ultra 9 185H, its integrated Arc GPU and 32 GB of memory, Janas-LLM reads a prompt at 939 tok/s and writes at 130 tok/s: llama.cpp, on the same laptop, 670 and 45.

On the same laptop	Janas-LLM	llama.cpp
reading a prompt of 1,024 tokens	939 tok/s	670 tok/s
writing (16 tokens)	130 tok/s	45 tok/s

Measured on 9-11 October 2026: llama-bench -p 1024 -n 16 and janas-bench --prompt 1024 --gen 16, both at their best configuration. On other machines the figures will differ. Details: Janas README.

The machine these figures come from

• Debian 13 (trixie) Linux, x86-64, kernel 6.12.107
• Intel Core Ultra 9 185H: 6 performance cores, 8 efficiency cores, 2 low-power cores; AVX2, FMA, F16C, AVX-VNNI
• its integrated Intel Arc GPU, through the Vulkan driver of Mesa 26.1.6
• 32 GB of DDR5-5600 memory
• a 1 TB NVMe SSD, about 5.7 GB/s reading
• llama.cpp build 2b18470 (18 September 2026), Vulkan backend

These are the model's weights converted to JNS, the format of Janas-LLM, the inference engine in C of Janas, for ordinary computers, with or without a GPU. The files are read by Janas-LLM only.

Get it

Janas-LLM for Linux x86-64 (Ubuntu 22.04, Debian 12 and later), then the model:

curl -LO https://github.com/prabanta-dev/janas/releases/latest/download/janas-linux-x86_64.tar.gz
tar xf janas-linux-x86_64.tar.gz && cd janas
./janas-get qwen3-0.6b
./janas-chat qwen3-0.6b

janas-get downloads the files of this repository and checks them against the fingerprints below; janas-chat with no model shows the catalog and downloads the one you choose. Building Janas-LLM from its sources instead: prabanta-dev/janas.

Files

File	Size	SHA-256	Converted from
qwen3-0.6b-q4km.jns	0.40 GB	9174da760919b16b9f3a4ae8738c2d53605412f40bb2c0fe68d60174bf8a4fb5	unsloth/Qwen3-0.6B-GGUF Qwen3-0.6B-Q4_K_M.gguf (catalog name qwen3-0.6b: Qwen3-0.6B, dense - also the draft of Qwen3-4B)

What was changed

These files are a modified work of the original model, as the Apache License 2.0 requires to be stated. Nothing was retrained or pruned: each file is a GGUF file quantized by the people named above, rewritten by Janas-LLM's gguf2jns in the order Janas reads it, with the metadata carried over.

Licence and attribution

Licensed under the Apache License 2.0, as the original model: see LICENSE.

• Model: Qwen/Qwen3-0.6B, by Alibaba Cloud (the Qwen team).
• Quantized GGUF: unsloth/Qwen3-0.6B-GGUF, by its authors.
• Converted to JNS by the Janas project with Janas-LLM (prabanta-dev/janas, GPL-3.0-or-later; the licence of the engine does not apply to these files).

LICENSE is the original repository's own.