Initial upload: SmolLM2-360M WebGPU
Browse files
README.md
ADDED
|
@@ -0,0 +1,49 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
base_model: HuggingFaceTB/SmolLM2-360M-Instruct
|
| 4 |
+
tags:
|
| 5 |
+
- smollm2
|
| 6 |
+
- webgpu
|
| 7 |
+
- browser-inference
|
| 8 |
+
- strix-halo
|
| 9 |
+
- amd
|
| 10 |
+
- unified-memory
|
| 11 |
+
- tiny-model
|
| 12 |
+
pipeline_tag: text-generation
|
| 13 |
+
---
|
| 14 |
+
|
| 15 |
+
# SmolLM2-360M on WebGPU
|
| 16 |
+
|
| 17 |
+
**HuggingFace's tiny 360M parameter model running in browser WebGPU.**
|
| 18 |
+
|
| 19 |
+
369 MB Q8_0 quantization. Loads in under 2 seconds. Generates instantly.
|
| 20 |
+
|
| 21 |
+
Built and tested on AMD Strix Halo (Radeon 8060S iGPU, 64GB unified memory).
|
| 22 |
+
|
| 23 |
+
## Quick Start
|
| 24 |
+
|
| 25 |
+
1. Download Q8_0 GGUF from [bartowski](https://huggingface.co/bartowski/SmolLM2-360M-Instruct-GGUF)
|
| 26 |
+
2. Place in `model_splits/` (no splitting needed — single file)
|
| 27 |
+
3. `node serve.js` (port 8180)
|
| 28 |
+
4. Open `http://localhost:8180` in Chrome
|
| 29 |
+
|
| 30 |
+
## Use Cases
|
| 31 |
+
|
| 32 |
+
- Lightweight chat and Q&A
|
| 33 |
+
- Classification and summarization
|
| 34 |
+
- Edge/IoT inference
|
| 35 |
+
- Testing and prototyping
|
| 36 |
+
|
| 37 |
+
## Hardware
|
| 38 |
+
|
| 39 |
+
Any WebGPU-capable device. Tested on AMD Strix Halo but works on much smaller hardware too. The model is only 369 MB — it fits anywhere.
|
| 40 |
+
|
| 41 |
+
## Why This Package
|
| 42 |
+
|
| 43 |
+
Part of a series making popular models available on WebGPU for AMD unified memory AI PCs. WebGPU bypasses broken ROCm and routes through the gaming driver stack.
|
| 44 |
+
|
| 45 |
+
## Credits
|
| 46 |
+
|
| 47 |
+
Built by Joshua (LJTSG) and Claude.
|
| 48 |
+
|
| 49 |
+
Co-Authored-By: Claude <noreply@anthropic.com>
|