Efficient_UG
Collection
Resources for “Understanding and Harnessing Sparsity in Unified Multimodal Models”, including the paper and efficient BAGEL-MoE checkpoints. • 3 items • Updated • 1
AI & ML interests
Efficient and adaptive foundation models across language and multimodal intelligence.
Recent Activity
Papers
Drop-Then-Recovery: How Redundant Are Vision-Language-Action Models?
Demystifying When Pruning Works via Representation Hierarchies
shwai-he
updated a
collection 27 days ago
s1ghhh
updated a
collection 27 days ago
shwai-he
updated a
collection 27 days ago
shwai-he
updated a
collection 29 days ago
shwai-he
updated a
collection about 2 months ago
s1ghhh
submitted a
paper to Daily Papers about 2 months ago
shwai-he
authored 3
papers 5 months ago
Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
Paper • 2402.10110 • Published • 3
What Matters in Transformers? Not All Attention is Needed
Paper • 2406.15786 • Published • 33
Capacity-Aware Inference: Mitigating the Straggler Effect in Mixture of Experts
Paper • 2503.05066 • Published • 5