Text Generation
RWKV
English
maba-instant
maba
maba-instant-v1
architecture
custom-architecture
state-space-model
ssm
mamba
mamba-3
recurrent
dgda
decoupled-gated-delta-attention
gated-deltanet
linear-attention
linear-recurrence
mla
multi-head-latent-attention
deepseek
flow-matching
continuous-flow
non-autoregressive
speculative-decoding
low-latency
microsecond-latency
cpu-inference
avx-512
avx2
simd
cpp
c++
fast-exit
early-exit
rlcd
brier-score
calibration
hft
algorithmic-trading
order-book
real-time
on-device
edge-ai
efficient-inference
zero-kv-cache
arena-allocator
sub-quadratic
llm
nlp
Instructions to use AndrewThompson1233/maba-instant-v1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- RWKV
How to use AndrewThompson1233/maba-instant-v1 with RWKV:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
|
Download report.md from AndrewThompson1233/maba-instant-v1: direct link, hf CLI and curl.
- Browser
- Download file 2.89 kB
-
https://huggingface.co/AndrewThompson1233/maba-instant-v1/resolve/main/report.md
- Command line
-
hf download hf://AndrewThompson1233/maba-instant-v1/report.md
-
curl -L -o report.md https://huggingface.co/AndrewThompson1233/maba-instant-v1/resolve/main/report.md
2.89 kB
Benchmark Results: maba-instant v1
Environment
- Host: Intel Xeon Platinum 8370C @ 2.80GHz (2 vCPUs allocated)
- Instructions: AVX-512F, AVX-512CD, AVX-512BW, AVX-512DQ, AVX-512VL
- Compiler: GCC 13.3.0 (-O3 -march=native -ffast-math -fopenmp -std=c++20)
- OS: Linux 6.6.137+
- Configuration: d = 256, L = 32 tokens, batch = 1
1. Latency and Throughput
Measured over 50 warmup iterations and 1,000 recorded iterations per model on identical input vectors:
| Model | Paradigm | P50 (us) | P90 (us) | P99 (us) | Mean (us) | Throughput |
|---|---|---|---|---|---|---|
| maba-instant v1 (Tier-0 Exit) | Linear projection | 0.47 | 0.80 | 1.37 | 0.55 | 1,811,636 tok/s |
| maba-instant v1 (Cascade) | 3-Tier JEV+DGDA+MLA | 3,341.48 | 4,777.16 | 8,742.22 | 3,826.68 | 8,362 tok/s |
| Mamba-3 SSM (Step) | Selective state space | 132.92 | 210.92 | 263.92 | 149.44 | 7,298 steps/s |
| RWKV-v6 (Step) | Linear recurrence | 205.20 | 239.90 | 639.93 | 226.34 | 4,422 steps/s |
| LLaMA-3 AR (TTFT) | Causal attention | 732.81 | 980.92 | 2,956.80 | 877.68 | 1,139 tok/s |
| LLaMA-3 AR (32 tokens) | Causal autoregressive | 25,410.97 | 32,999.95 | 58,468.28 | 27,536.60 | 1,162 tok/s |
| Discrete Diffusion (32 tokens) | 16-step canvas flow | 26,848.30 | 31,771.26 | 52,105.50 | 28,227.44 | 1,133 tok/s |
2. Memory Usage
Resident memory monitored via /proc/self/status during 1,000 iterations:
| Model | Weights | Active State | KV Growth | Peak RSS |
|---|---|---|---|---|
| maba-instant v1 | 1.71 MB | 80 KB (static) | 0 bytes | 11.6 MB |
| Mamba-3 SSM | 0.19 MB | 64 KB (static) | 0 bytes | 11.1 MB |
| RWKV-v6 | 1.02 MB | 1 KB (static) | 0 bytes | 11.2 MB |
| LLaMA-3 AR | 3.58 MB | 64 KB (32 tokens) | Linear with L | 16.8 MB |
| Discrete Diffusion | 0.25 MB | 64 KB (static) | 0 bytes | 12.1 MB |
3. Order Book Matching Simulation
Continuous double auction matching simulation with 60,000 order operations and simulated high-frequency taker flow:
| Agent | Latency (us) | Net PnL (USD) | Maker Fills | Taker Fills | Cancels Done | Adverse Fills | Sharpe | Max Drawdown |
|---|---|---|---|---|---|---|---|---|
| maba-instant v1 | 0.90 | +1,854.48 | 3,154 | 3,747 | 57,309 | 2,350 | 3.34 | $29.31 |
| RWKV-v6 | 12.00 | +752.17 | 3,996 | 3,985 | 56,487 | 3,080 | 1.27 | $100.12 |
| Mamba-3 SSM | 20.00 | +597.09 | 3,658 | 3,881 | 56,802 | 2,850 | 1.01 | $115.46 |
| LLaMA-3 AR | 25,000.00 | -479.85 | 386 | 0 | 243 | 373 | -0.57 | $670.65 |
| Discrete Diffusion | 26,000.00 | -405.60 | 394 | 0 | 223 | 361 | -0.44 | $635.62 |
4. Stability Test
Multithreaded run executing 100,000 consecutive inference requests across 4 worker threads (bin/maba_endurance):
- Total requests: 100,000
- NaN occurrences: 0
- Inf occurrences: 0
- Process RSS growth: 11.6 MB to 12.0 MB (delta +0.4 MB, bounded)
- Exit code: 0