dicksondickson/Ling-3.0-tiny-oQ5e-bf16-MLX
This model is a quantization of:
https://huggingface.co/inclusionAI/Ling-3.0-tiny
This checkpoint was quantized using oMLX 0.7.0 with imatrix enabled.
Important tensors are left at bf16 which is for Apple M3 chips and later.
Run the model using oMLX:
https://github.com/jundot/omlx
- Downloads last month
- 22
Model size
8B params
Tensor type
U32
路
BF16 路
F32 路
Hardware compatibility
Log In to add your hardware
5-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support
Model tree for dicksondickson/Ling-3.0-tiny-oQ5e-bf16-MLX
Base model
inclusionAI/Ling-3.0-tiny