Foundation Text-Generation Models Below 360M Parameters
Great candidates for fine-tuning targeting Wllama and Transformers.js for mobile devices, ordered by number of parameters.
Text Generation • 0.4B • Updated • 397k • 137Note License: apache-2.0 Context Length: 8k
facebook/MobileLLM-R1-360M-base
Text Generation • 0.4B • Updated • 57 • 14Note License: fair-noncommercial-research Context Length: 4k
LiquidAI/LFM2.5-350M-Base
Text Generation • 0.4B • Updated • 15.7k • 34Note License: lfm1.0 Context Length: 32k
PleIAs/Pleias-350m-Preview
0.4B • Updated • 3.88k • 27Note License: apache-2.0 Context Length: 2k
OuteAI/Lite-Oute-1-300M
Text Generation • 0.3B • Updated • 26.5k • 9Note License: apache-2.0 Context Length: 4k
keeeeenw/MicroLlama
Text Generation • 0.3B • Updated • 734 • 53Note License: apache-2.0 Context Length: 2k
google/gemma-3-270m
Text Generation • 0.3B • Updated • 59.4k • 1.11kNote License: gemma Context Length: 32k
UUFO-Aigis/Pico-OpenLAiNN-250M
0.3B • Updated • 14 • 3Note License: apache-2.0 Context Length: 2k
upstage/TinySolar-248m-4k
Text Generation • 0.2B • Updated • 741 • 12Note License: apache-2.0 Context Length: 4k
M4-ai/TinyMistral-248M-v3
Text Generation • 0.2B • Updated • 83 • 8Note License: apache-2.0 Context Length: 2k
LiquidAI/LFM2.5-230M-Base
Text Generation • 0.2B • Updated • 12.6k • 22Note License: lfm1.0 Context Length: 32k
MiniLLM/MiniPLM-llama3.1-212M
Text Generation • 0.2B • Updated • 44 • 6Note License: apache-2.0 Context Length: 1k
MiniLLM/MiniPLM-Qwen-200M
Text Generation • 0.2B • Updated • 9.2k • 9Note License: apache-2.0 Context Length: 1k
xTimeCrystal/MiniModel-200M-Base
Text Generation • 0.2B • Updated • 112 • 30Note License: apache-2.0 Context Length: 2k
princeton-nlp/Sheared-Pythia-160m
Text Generation • Updated • 82 • 4Note License: apache-2.0 Context Length: 2k
JackFram/llama-160m
Text Generation • 0.2B • Updated • 44k • 37Note License: apache-2.0 Context Length: 2k
SmallDoge/Doge-160M
Text Generation • 0.2B • Updated • 110 • 7Note License: apache-2.0 Context Length: 2k
EleutherAI/pythia-160m
Text Generation • 0.2B • Updated • 3.47M • 46Note License: apache-2.0 Context Length: 2k
BananaMind/BananaMind-2-Pro-Preview
Text Generation • 0.2B • Updated • 164 • 23Note License: other (bananamind-community-license-1.0) Context Length: 3k
Harikrish2727/BetterGPT-150M
Text Generation • 0.2B • Updated • 92 • 1Note License: apache-2.0 Context Length: 2k
jhu-clsp/ettin-decoder-150m
Fill-Mask • Updated • 5.2k • 6Note License: mit Context Length: 8k
StentorLabs/Portimbria-150M
Text Generation • 0.2B • Updated • 134 • 11Note License: apache-2.0 Context Length: 4k
AuroraAI-Research/Aurora1.0-150M
Text Generation • 0.1B • Updated • 880 • 9Note License: apache-2.0 Context Length: 1k
facebook/MobileLLM-R1-140M-base
Text Generation • 0.1B • Updated • 1.14k • 23Note License: fair-noncommercial-research Context Length: 4k
joelhenwang/OdinNext-138M-Base
Text Generation • 0.1B • Updated • 118 • 3Note License: apache-2.0 Context Length: 2k
openai-community/gpt2
Text Generation • 0.1B • Updated • 15.2M • 4.21kNote License: mit Context Length: 1k
HuggingFaceTB/SmolLM2-135M
Text Generation • 0.1B • Updated • 1.76M • 243Note License: apache-2.0 Context Length: 8k
amd/AMD-Llama-135m
Text Generation • 0.1B • Updated • 6.63k • 120Note License: apache-2.0 Context Length: 2k
AxiomicLabs/GPT-X2.5-135M
Text Generation • 0.1B • Updated • 1.06k • 66Note License: apache-2.0 Context Length: 8k
MaliosDark/Nexus-Erebus-135M
Text Generation • 0.1B • Updated • 101 • 10Note License: other Context Length: 1k
MiniLLM/MiniPLM-Mamba-130M
Text Generation • 0.1B • Updated • 93 • 4Note License: apache-2.0 Context Length: 1k
Nikity/lille-130m-base
Text Generation • 0.1B • Updated • 161 • 18Note License: apache-2.0 Context Length: 0.5k
EleutherAI/gpt-neo-125m
Text Generation • 0.2B • Updated • 496k • 231Note License: mit Context Length: 2k
opencerebral/Boris-1.3-125M
Text Generation • 0.1B • Updated • 338 • 4Note License: apache-2.0 Context Length: 1k
TobiasLogic/Museko-125M
Text Generation • 0.1B • Updated • 151 • 9Note License: apache-2.0 Context Length: 2k
facebook/opt-125m
Text Generation • Updated • 6.52M • 324Note License: other (OPT-175B License Agreement, non-commercial research only) Context Length: 2k
BEE-spoke-data/smol_llama-101M-GQA
Text Generation • 0.1B • Updated • 515 • 33Note License: apache-2.0 Context Length: 1k
UUFO-Aigis/Pico-OpenLAiNN-100M
0.1B • Updated • 17 • 2Note License: apache-2.0 Context Length: 2k
SupraLabs/Supra2-100M-Base
Text Generation • 0.1B • Updated • 1.25k • 28Note License: apache-2.0 Context Length: 1k
raincandy-u/Rain-100M
Text Generation • 97.2M • Updated • 408 • 23Note License: apache-2.0 Context Length: 4k
FlameF0X/TinyMoE-100m-2x8-retrained
Text Generation • 99.8M • Updated • 557 • 3Note License: mit Context Length: 1k
Sandroeth/cali-0.1B
Text Generation • 0.1B • Updated • 67 • 5Note License: apache-2.0 Context Length: 1k
HuggingFaceTB/nanowhale-100m-base
Text Generation • 0.1B • Updated • 961 • 24Note License: apache-2.0 Context Length: 2k
Felladrin/Minueza-2-96M
Text Generation • 96M • Updated • 217 • 7Note License: apache-2.0 Context Length: 4k
Felladrin/Minueza-3-95M-Base
Text Generation • 94.7M • Updated • 196 • 3Note License: apache-2.0 Context Length: 8k
finnianx/Gros-Michel-90m-Base-v2
94.9M • Updated • 93 • 6Note License: not specified Context Length: 1k
appvoid/palmer-006
Text Generation • 91.1M • Updated • 455 • 10Note License: other (appvoid-noncommercial-model-license-1.0) Context Length: 256k
distilbert/distilgpt2
Text Generation • 88.2M • Updated • 2.06M • 648Note License: apache-2.0 Context Length: 1k
Quazim0t0/Escarda-86M-Base
Text Generation • 97.3M • Updated • 741 • 5Note License: apache-2.0 Context Length: 4k
Quazim0t0/Byrne-86M-Base
Text Generation • 96.9M • Updated • 729 • 4Note License: apache-2.0 Context Length: 4k
weiser/82M-0.4
Text Generation • 82.1M • Updated • 24Note License: apache-2.0 Context Length: 1k
BEE-spoke-data/smol_llama-81M-tied
Text Generation • 81.3M • Updated • 233 • 10Note License: apache-2.0 Context Length: 1k
opencerebral/Boris-1.3-75M
Text Generation • 77.4M • Updated • 406 • 1Note License: apache-2.0 Context Length: 1k
MinimaLabs/KeyLM-75M
Text Generation • 75.3M • Updated • 311 • 18Note License: apache-2.0 Context Length: 2k
GODELEV/Archaea-74M-V1.1
Text Generation • 74M • Updated • 75 • 4Note License: mit Context Length: 1k
EleutherAI/pythia-70m
95.6M • Updated • 601k • 86Note License: apache-2.0 Context Length: 2k
JackFram/llama-68m
Text Generation • Updated • 110k • 38Note License: apache-2.0 Context Length: 2k
jhu-clsp/ettin-decoder-68m
Fill-Mask • Updated • 486 • 2Note License: mit Context Length: 8k
OuteAI/Lite-Oute-1-65M
Text Generation • 65M • Updated • 166 • 12Note License: apache-2.0 Context Length: 2k
WhirlwindAI/MetaNova-1-60M
Text Generation • 62.7M • Updated • 263 • 8Note License: apache-2.0 Context Length: 3k
SmallDoge/Doge-60M
Text Generation • 54.6M • Updated • 123 • 5Note License: apache-2.0 Context Length: 2k
BananaMind/BananaMind-2-Medium
Text Generation • 55.9M • Updated • 882 • 17Note License: apache-2.0 Context Length: 3k
MaliosDark/Nexus-Erebus-50M
Text Generation • 54.1M • Updated • 89 • 8Note License: apache-2.0 Context Length: 1k
MaliosDark/Isabel-50M
Text Generation • 54.1M • Updated • 83 • 11Note License: apache-2.0 Context Length: 1k
SupraLabs/Supra-50M-Base
Text Generation • 51.8M • Updated • 1.06k • 47Note License: apache-2.0 Context Length: 1k
veyra-ai/Veyra2-Apricot-50M-Base
Text Generation • 49.3M • Updated • 650 • 15Note License: apache-2.0 Context Length: 2k
StentorLabs/Stentor3-50M
Text Generation • 49.4M • Updated • 298 • 7Note License: apache-2.0 Context Length: 4k
GODELEV/Rose-Mini
Text Generation • 49.4M • Updated • 391 • 16Note License: apache-2.0 Context Length: 1k
harrrshall/BarunLM-35M
Text Generation • 35.1M • Updated • 54Note License: apache-2.0 Context Length: 2k
sabari2005/cyberslm-33m-base
Text Generation • 33.5M • Updated • 57 • 1Note License: apache-2.0 Context Length: 4k
Felladrin/Minueza-32M-Base
Text Generation • 32.8M • Updated • 1.19k • 19Note License: apache-2.0 Context Length: 2k
GerbilLab/Gerbil-A-32m
Text Generation • Updated • 130 • 2Note License: apache-2.0 Context Length: 2k
jhu-clsp/ettin-decoder-32m
Text Generation • Updated • 771Note License: mit Context Length: 8k
fromziro/Er-Large-30M
31.9M • Updated • 131 • 4Note License: apache-2.0 Context Length: 1k
EleutherAI/pythia-31m-deduped
Text Generation • 55.7M • Updated • 980 • 5Note License: apache-2.0 Context Length: 2k
BananaMind/BananaMind-2-Mini
Text Generation • 28.3M • Updated • 270 • 14Note License: apache-2.0 Context Length: 4k
BananaMind/BananaMind-2-MoE
Text Generation • 26.1M • Updated • 476 • 10Note License: apache-2.0 Context Length: 4k
SmallDoge/Doge-20M
Text Generation • 13.1M • Updated • 1.04k • 13Note License: apache-2.0 Context Length: 2k
StentorLabs/Stentor3-20M
Text Generation • 20.3M • Updated • 93 • 6Note License: apache-2.0 Context Length: 4k
jhu-clsp/ettin-decoder-17m
Fill-Mask • Updated • 8.09k • 2Note License: mit Context Length: 8k
MultivexAI/Plyx-15M
Text Generation • 16.1M • Updated • 173 • 6Note License: apache-2.0 Context Length: 512
EleutherAI/pythia-14m-deduped
Text Generation • 39.2M • Updated • 22.6k • 31Note License: apache-2.0 Context Length: 2k
fromziro/Er-Medium-12.5M
12.5M • Updated • 87 • 11Note License: apache-2.0 Context Length: 384
BananaMind/BananaMind-2-Nano
Text Generation • 12.1M • Updated • 493 • 13Note License: apache-2.0 Context Length: 4k
liodon-ai/slm-10m
Text Generation • 12.1M • Updated • 204 • 13Note License: apache-2.0 Context Length: 1k
Dream-W/ObsidianSmall-Base
Text Generation • 9.77M • Updated • 55 • 4Note License: not specified Context Length: 1k
User01110/CMA-8M
Text Generation • 9.08M • Updated • 433 • 21Note License: apache-2.0 Context Length: 1k
DedeProGames/DynamicMind-Mini
8.88M • Updated • 135 • 5Note License: apache-2.0 Context Length: 1k
Harley-ml/Tenete-8M
Text Generation • 8.29M • Updated • 116 • 8Note License: mit Context Length: 1k
AtomixLabs/AtomixS2-5M-v1.0
Text Generation • 5.98M • Updated • 465 • 3Note License: apache-2.0 Context Length: 512
LH-Tech-AI/Spark-5M-Base-v4
Text Generation • 4.98M • Updated • 54 • 3Note License: not specified Context Length: 512
MaliosDark/Nexus-Erebus-3M
Text Generation • 3M • Updated • 72 • 3Note License: mit Context Length: 512
UniversalComputingResearch/Atom2.7m
Text Generation • 2.74M • Updated • 147 • 16Note License: apache-2.0 Context Length: 512
MihaiPopa-1/CinnabarLM-1.4M-Base
Text Generation • 1.51M • Updated • 32Note License: apache-2.0 Context Length: 2k
Harley-ml/Dillionv2-1.3M
Text Generation • 1.29M • Updated • 283 • 5Note License: mit Context Length: 384
fromziro/Er-Tiny-1.3M
1.33M • Updated • 57 • 7Note License: apache-2.0 Context Length: 384
56m/Dumb-1.2-RC1
Text Generation • 34.6M • Updated • 75Note License: apache-2.0 Context Length: 1k
AtomixLabs/Photon-2.0-1M
Text Generation • 1.05M • Updated • 210 • 8Note License: apache-2.0 Context Length: 512
Glint-Research/Glint-1.3
Updated • 83 • 13Note License: mit Context Length: 256