LJTSG commited on
Commit
8e605b3
·
verified ·
1 Parent(s): 8a40751

Initial upload: SmolLM2-360M WebGPU

Browse files
Files changed (1) hide show
  1. README.md +49 -0
README.md ADDED
@@ -0,0 +1,49 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: HuggingFaceTB/SmolLM2-360M-Instruct
4
+ tags:
5
+ - smollm2
6
+ - webgpu
7
+ - browser-inference
8
+ - strix-halo
9
+ - amd
10
+ - unified-memory
11
+ - tiny-model
12
+ pipeline_tag: text-generation
13
+ ---
14
+
15
+ # SmolLM2-360M on WebGPU
16
+
17
+ **HuggingFace's tiny 360M parameter model running in browser WebGPU.**
18
+
19
+ 369 MB Q8_0 quantization. Loads in under 2 seconds. Generates instantly.
20
+
21
+ Built and tested on AMD Strix Halo (Radeon 8060S iGPU, 64GB unified memory).
22
+
23
+ ## Quick Start
24
+
25
+ 1. Download Q8_0 GGUF from [bartowski](https://huggingface.co/bartowski/SmolLM2-360M-Instruct-GGUF)
26
+ 2. Place in `model_splits/` (no splitting needed — single file)
27
+ 3. `node serve.js` (port 8180)
28
+ 4. Open `http://localhost:8180` in Chrome
29
+
30
+ ## Use Cases
31
+
32
+ - Lightweight chat and Q&A
33
+ - Classification and summarization
34
+ - Edge/IoT inference
35
+ - Testing and prototyping
36
+
37
+ ## Hardware
38
+
39
+ Any WebGPU-capable device. Tested on AMD Strix Halo but works on much smaller hardware too. The model is only 369 MB — it fits anywhere.
40
+
41
+ ## Why This Package
42
+
43
+ Part of a series making popular models available on WebGPU for AMD unified memory AI PCs. WebGPU bypasses broken ROCm and routes through the gaming driver stack.
44
+
45
+ ## Credits
46
+
47
+ Built by Joshua (LJTSG) and Claude.
48
+
49
+ Co-Authored-By: Claude <noreply@anthropic.com>