INT8 Quantizations

#235

by Adamajini - opened Sep 3

Discussion

Adamajini

Sep 3

Please can we get an official INT8 Quantization of Anima Base, Aesthetic & Turbo.

Thank you

khanghy1000

Sep 4

https://github.com/silveroxides/convert_to_quant
ctq -i Anima-turbo-v1-1.safetensors -o Anima-turbo-v1-1-int8convrot.safetensors --int8 --scaling_mode row --convrot --convrot-group-size 256 --comfy_quant --save-quant-metadata --anima --simple
It takes like one minute to quantize them yourself

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment