AI & ML interests

None defined yet.

fffiloniΒ 
posted an update 6 days ago
view post
Post
2,714
Carbon-X brings DNA and language together: it reads sequences and answers questions about them 🧬

To accompany the release article, I put together Carbon-X Playground: five experiments exploring sequence completion, single-letter changes, regulatory roles, DNA origins and motif finding.

Try curated samples or your own sequences, ask questions and compare answers with references when available.

Built with Gradio, running on ZeroGPU.

πŸ“– HuggingFaceBio/Carbon-X-Release
🧬 fffiloni/Carbon-X-Playground
NymboΒ 
posted an update 12 days ago
view post
Post
3,725
Introducing Live Subtitles, a Windows tray app that captions anything your PC is playing and isn't butt ugly. live and fully local. It runs NVIDIA's Parakeet-unified 0.6B on your GPU, puts words on screen about 0.36 s after they're spoken, and uses less than one CPU core while it does it.

I built a benchmark for it out of real TV, podcasts, earnings calls and a short film. Parakeet-unified scores 12.1% WER there, close to Nemotron streaming's 11.4%, but with much better punctuation and lower worst-case delay. Once a caption is on screen it never gets rewritten or jumps lines, and the overlay disappears when nobody's talking.

No NVIDIA GPU? It falls back to Nemotron on the CPU, which also covers 30 other languages. It can also write SRT/ASS/VTT files for videos on disk.

Windows only. The GPU engine needs an NVIDIA card with ~3.2 GB of free VRAM. MIT.

Edit: the first version of this post said 13.8% vs 17.0%. The replies caught a scoring bug (numbers weren't normalized), so the benchmark now uses Whisper's English normalizer and the numbers above are re-scored.

Get it here:
https://github.com/Nymbo/Live-Subtitles

Models:
nvidia/parakeet-unified-en-0.6b
nvidia/nemotron-speech-streaming-en-0.6b
  • 7 replies
Β·
fffiloniΒ 
posted an update 18 days ago
view post
Post
449
πŸ“– A gamebook you can play in your own words, powered by local Decision Models.

Traditional gamebooks offer explicit branches: β€œTo enter the forest, turn to page 42.” In Choose your own adventure, you can describe an action, question a character, or ask what you already know before deciding. Clickable choices remain available.

The story’s branches and consequences are authored. Natural language adds a flexible way to interact with them, with conversations between actions.

I built this project to explore a concrete role for Decision Models in an interactive application:

β€’ Kev-4B makes structured decisions: matching intentions to available actions and distinguishing acting from discussing.
β€’ Ink manages story progression, discoveries, inventory and endings.
β€’ Qwen3-8B selects dialogue responses from authored content available in the current state.

Both models run locally inside the Space through llama.cpp, using quantized GGUFs. You can inspect the model calls, scores and routing decisions directly in the interface.

The current release includes three adventures in French and English, with a pack format for adding new stories without changing the engine.

It’s still experimental, and interpretations can go wrong. I’d love feedback on how it feels to playβ€”and on this use of Decision Models to connect natural language with explicit game logic.

Try and play here: fffiloni/choose-your-own-adventure-dm πŸ€—
  • 1 reply
Β·
fffiloniΒ 
posted an update about 1 month ago
view post
Post
683
Been pushing Viggle Animate a bit further πŸ‘€

Viggle Mine is my take on longer, harder character replacement shots β€” crowds, distance changes, characters turning their back and reappearing.

Still experimental, but it’s getting surprisingly robust.

Try it : fffiloni/Viggle-Mine πŸ€—
fffiloniΒ 
posted an update 2 months ago
view post
Post
2,217
If an agent can build the obvious demo, the obvious demo probably isn’t worth building anymore.
For years, turning a research repo into something people could actually try was valuable by itself.
That part is becoming automated β€” and that’s a good thing.

Which means the interesting work moves elsewhere: finding the weird use case, the right interaction, the unexpected model combination β€” or simply knowing which paper is worth anyone’s attention.

The demo used to be the product. Now it needs a point of view.
  • 1 reply
Β·
NymboΒ 
posted an update 3 months ago
view post
Post
2,593
Anthropic gave me six months of Claude Max 20x through the Claude for Open Source program, granted based on my Hugging Face work. Thank you
Anthropic
for supporting open source.

So far I've been pointing it at Markdown Minimap, an Obsidian plugin that adds a scrollable IDE-style minimap to your notes. This week I've been clearing a backlog of user-reported issues on it, with Claude often handling them end to end.

https://github.com/Nymbo/Markdown-Minimap β€” issues and PRs welcome.
NymboΒ 
posted an update 3 months ago
view post
Post
6,203
Introducing Inflect-v2, two exceptionally small, open-weight English TTS models at just 3.9M and 9.3M parameters. Both generate speech multiple times faster than real-time on CPU. Despite their size, Inflect-v2 delivers quality that is competitive with much larger lightweight TTS systems, including KittenTTS, Piper, and Supertonic-3.

CPU, CUDA, PyTorch, and ONNX are supported. Apache 2.0.

See it for yourselves:
owensong/Inflect-Micro-v2
owensong/Inflect-Nano-v2

Try the Demos:
Nymbo/Inflect-TTS (unlimited CPU usage)
owensong/Inflect-v2 (ultra-fast ZeroGPU usage)
  • 6 replies
Β·
fffiloniΒ 
posted an update 4 months ago
fffiloniΒ 
posted an update 4 months ago
view post
Post
1,924
I made a Hugging Face Space for SCAIL-2 πŸ€—

Reference character + driving motion β†’ animated result.

A simple demo to explore the paper’s core workflow with curated examples.

πŸ‘‰ fffiloni/SCAIL-2
  • 1 reply
Β·
fffiloniΒ 
posted an update 4 months ago
view post
Post
873
⏱️ Built a small Space for Visual Chronometer / Pulse of Motion.

Upload a video and estimate its Physical FPS: the frame rate implied by visual motion, independent of metadata.
Useful to inspect β€œchronometric hallucination” in generated videos: clips that look smooth, but move with the wrong physical time scale.

Try it here: fffiloni/Pulse-of-Motion
  • 1 reply
Β·
fffiloniΒ 
posted an update 4 months ago
view post
Post
1,707
A few weeks ago, @victor opened the door: coding agents can now ship Hugging Face Spaces autonomously.

I pulled on that thread.

As someone who builds and ships Gradio demos regularly, I didn’t just want to reproduce the loop. I wanted to see what happens when that loop is plugged into the whole Hugging Face stack.

The interesting part is not only that an agent can ship a Space.

It’s what happens when Space generation becomes a first-class Hugging Face workflow.

That became Agentic Space Factory.

More soon. πŸ€—
  • 1 reply
Β·
victorΒ 
posted an update 5 months ago
view post
Post
6,726
Sharing how I built the LongCat-Video-Avatar 1.5 Space (+500k views on X) in one agent session. Gave a coding agent its own AI lab on ZeroGPU, framed the goal, walked away. It designed, deployed, tested against the live API, fixed, shipped.

Full recipe with the copy-paste prompt: https://huggingface.co/blog/victor/building-zerogpu-spaces-autonomously
  • 1 reply
Β·
fffiloniΒ 
posted an update 6 months ago
view post
Post
3,883
I built HF Radio on Hugging Face Spaces πŸ“»
fffiloni/HF-Radio

A live community radio for AI-generated songs, powered by tracks created with ACE-Step.

You can tune in, discover community-made songs in many languages, vote on what sounds good, and mark your real favorites as Bangers.

The more people listen, vote, and create, the better the station gets.

Under the hood, it connects a few Hugging Face pieces together:

Spaces for the live app, HF buckets for community tracks, OAuth for signed-in listeners, server-side streaming with ffmpeg, hourly playlist refreshes, moderation, jingles, and community feedback loops.

It’s not just a playlist.

It’s a shared taste experiment:
new songs get a shot every hour, and the community helps decide what deserves another spin.

Come listen.
Find weird gems.
Support the Bangers.
Shape the radio.

β€”> fffiloni/HF-Radio
fffiloniΒ 
posted an update 6 months ago
view post
Post
534
Great technical guide by Nico Martin on the Hugging Face blog, showing how to use Transformers.js inside a Chrome extension and run ONNX models from the Hub locally with WebGPU inside a Manifest V3 extension.

The interesting part: this is not just a chatbot in a side panel.

The article walks through the architecture behind a browser agent that can read open tabs, query webpages, search history, and highlight elements directly on the page β€” with models downloaded from the Hugging Face Hub, cached under the extension origin, and executed locally instead of being called through a remote API for every prompt.

A strong blueprint for building local-first web copilots, reading assistants, and AI-powered browsing workflows.

Article: https://huggingface.co/blog/transformersjs-chrome-extension
fffiloniΒ 
posted an update 6 months ago
view post
Post
370
I’ve been reading β€œWhat if AI systems weren’t chatbots?”
What if AI systems weren't chatbots? (2605.07896) πŸ‘€

The paper asks a simple but important question: what if the chatbot interface is not just a neutral wrapper around AI models, but part of the problem?

A chatbot can make a system feel more capable, more certain, and more β€œhuman” than it really is. That matters, because interfaces shape how we trust, use, and delegate to AI systems.

When everything becomes: ask β†’ answer
we can lose sight of the actual workflow:
- parameters
- alternatives
- uncertainty
- intermediate steps
- failure modes
- human control

For creative AI especially β€” image, video, editing, animation β€” I’m not sure β€œchat” should always be the default interface.

Sometimes we need a conversation.
But often we need a canvas, a timeline, sliders, masks, previews, comparisons, and visible pipelines.

This is also why I find many open ML demos interesting: Spaces, Gradio apps, visual tools, small focused interfaces.

They often explore another direction β€” not just better assistants, but better tools. πŸ€—
  • 2 replies
Β·
fffiloniΒ 
posted an update 6 months ago
fffiloniΒ 
posted an update 6 months ago
view post
Post
1,842
πŸš€ RB-Modulation is back on Hugging Face Spaces!

This is an older project that recently broke due to dependency changes, but it’s now fixed and running again βœ…

πŸ‘‰ What’s fixed:
- GroundingDINO & LangSAM installation
- compatibility with recent environments
- GPU inference running smoothly again

πŸ‘‰ Try it here:
fffiloni/RB-Modulation

Feel free to give it a try again β€” feedback welcome!
victorΒ 
posted an update 7 months ago
view post
Post
6,371
Want to share my enthusiasm for zai-org/GLM-5.1 here too πŸ”₯

I think we have it: our open source Claude Code = GLM-5.1 + Pi (https://pi.dev/) - Built a Three.js racing game to eval and it's extremely impressive. Thoughts:

- One-shot car physics with real drift mechanics (this is hard)

- My fav part: Awesome at self iterating (with no vision!) created 20+ Bun.WebView debugging tools to drive the car programmatically and read game state. Proved a winding bug with vector math without ever seeing the screen

- 531-line racing AI in a single write: 4 personalities, curvature map, racing lines, tactical drifting. Built telemetry tools to compare player vs AI speed curves and data-tuned parameters

- All assets from scratch: 3D models, procedural textures, sky shader, engine sounds, spatial AI audio!

- Can do hard math: proved road normals pointed DOWN via vector cross products, computed track curvature normalized by arc length to tune AI cornering speed

You are going to hear about this model a lot in the next months - open source let's go - and thanks z-aiπŸš€πŸš€
  • 5 replies
Β·
fffiloniΒ 
posted an update 7 months ago
view post
Post
3,210
✨ PASD Magnify is back on Hugging Face Spaces

fffiloni/PASD

PASD isn’t recent, but still delivers strong results β€” worth restoring rather than replacing.

Getting it to run again wasn’t a simple dependency issue.
It relied on parts of diffusers that no longer exist, while moving to Gradio 6 forced a much newer HF stack β€” and I couldn’t modify the original source directly.

Recreating the old environment wasn’t practical.
So I patched the downloaded code at runtime before import and made it compatible with today’s stack.

That ended up being the only approach that held without forking or freezing everything to outdated versions.

If you’ve used it before (or are curious), feel free to give it another try.
fffiloniΒ 
posted an update 7 months ago
view post
Post
2,884
βœ… Back up and running!

My TIGER app is now fully working again, with fixes and full compatibility with Gradio 6 πŸš€

It lets you:
- πŸŽ™οΈ Separate multiple speakers from an audio file
- 🎬 Extract each speaker directly from a video
- 🎧 Split audio into dialog, music, and sound effects (DnR)
- πŸŽ₯ Apply DnR separation directly on videos

All powered by lightweight TIGER models for fast and efficient speech separation.

Try it here πŸ‘‰ fffiloni/TIGER-audio-extraction