MOPD: Multi-Teacher On-Policy Distillation for Capability Integration in LLM Post-Training
Paper • 2606.30406 • Published • 29
Distillation
-
-
TurnOPD: Making On-Policy Distillation Turn-Aware for Efficient Long-Horizon Agent Training
Paper • 2607.05804 • Published • 18 -
Trust Region Policy Distillation
Paper • 2607.04751 • Published • 35 -
SEED: Self-Evolving On-Policy Distillation for Agentic Reinforcement Learning
Paper • 2607.14777 • Published • 103 -
ShortOPD: Recovering Pruned LLMs with Short-to-Long On-Policy Distillation
Paper • 2607.13124 • Published • 14 -
Visual Contrastive Self-Distillation
Paper • 2607.21556 • Published • 47 -
From Proprietary to Open-Source: Bridging the Distribution Gap via Multi-Agent Protocol Distillation in Agentic Search
Paper • 2607.24280 • Published • 83 -
Pass the Baton: Trajectory-Relayed On-Policy Distillation
Paper • 2607.26057 • Published • 29 -
Enhancing Rubric-based RL via Self-Distillation
Paper • 2607.18082 • Published • 12 -
AgentOPSD: Recursive Self-Distillation for Agentic Reinforcement Learning
Paper • 2608.05987 • Published • 82 -
Agent Memory Distillation: Empowering Small LLM Agents with Hierarchical Teacher Memory
Paper • 2608.07169 • Published • 45 -
SPOT: Sparse Probing and Outcome Calibration for On-Policy Distillation
Paper • 2608.04419 • Published • 26 -
Self-Supervised Visual On-Policy Distillation
Paper • 2608.14144 • Published • 54 -
Latent On-Policy Self-Distillation
Paper • 2608.13040 • Published • 24 -
SimpleOPD: Simple Tokenizer-Agnostic On-Policy Distillation for Long-Context Reasoning
Paper • 2608.14277 • Published • 36 -
D^3-MOPD: Adaptive Dynamic Domain ScheDuling for Efficient Multi-Teacher Distillation
Paper • 2608.24987 • Published • 28 -
Does On-Policy Distillation Really Distill? From Noisy Teacher to Self-Improvement
Paper • 2608.31046 • Published • 84 -
Repo-To-Skill: Distilling GitHub Repositories Into AI4AI Skills
Paper • 2609.02749 • Published • 147 -
Rethinking On-Policy Distillation of Large Language Models II: One Training Example
Paper • 2609.04172 • Published • 80 -
Verify Before You Distill: Prompt-Level Teacher Gating for On-Policy Distillation
Paper • 2609.02998 • Published • 15 -
Eliciting Weak-to-Strong Generalization with On-Policy Reverse Distillation
Paper • 2609.08798 • Published • 68 -
Beyond Teacher Assignment: Domain-Normalized Multi-Teacher On-Policy Distillation
Paper • 2609.35347 • Published • 59 -
On-Policy or Off-Policy Learning? A Systematic Study of Distillation Dynamics
Paper • 2609.35259 • Published • 32 -
Self-Retrospection Distillation: Turning Post-hoc Experiences into Prior Foresight
Paper • 2610.08077 • Published • 165 -
Tree-Aware Posterior Distillation for Long-Horizon Agentic Reinforcement Learning
Paper • 2610.23181 • Published • 43 -
TraceForge: Distilling with Your Own Thinking
Paper • 2610.29680 • Published • 30 -
DecisionRank: On-Policy Distillation for Decision-Model Rerankers
Paper • 2610.42128 • Published • 15