Qwen3.8-27B-INT8

INT8 quantization of Qwen/Qwen3.8-27B, produced with llm-compressor.

Vision encoder, gated-delta attention (conv1d / linear_attn), lm_head, embeddings, and norm layers are kept in original precision.

Downloads last month
297
Safetensors
Model size
28B params
Tensor type
BF16
ยท
I8
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for lokeshe09/Qwen3.8-27B-INT8

Base model

Qwen/Qwen3.8-27B
Quantized
(1,707)
this model