INT4 quantizations of Qwen3.8-27B calibrated at 262k context: AWQ and GPTQ weights, each in bf16-KV and calibrated fp8-e4m3 KV editions.
-
abhishekchohan/Qwen3.8-27B-AWQ-INT4-FP8KV
Image-Text-to-Text • 28B • Updated • 2.29k • 1 -
abhishekchohan/Qwen3.8-27B-AWQ-INT4
Image-Text-to-Text • 28B • Updated • 249 -
abhishekchohan/Qwen3.8-27B-GPTQ-INT4-FP8KV
Image-Text-to-Text • 28B • Updated • 43.3k • 2 -
abhishekchohan/Qwen3.8-27B-GPTQ-INT4
Image-Text-to-Text • 28B • Updated • 4.14k