arxiv
PublishedJune 17, 2026 at 4:00 AM
—neutral
PowerOPD: Stabilizing On-Policy Distillation with Bounded Power Transformation
Publisher summary· verbatim
arXiv:2606.17199v1 Announce Type: cross Abstract: Standard on-policy distillation (OPD) for large language models estimates the reverse-KL objective using student-sampled tokens, yielding an unbiased single-sample Monte Carlo estimator that avoids vocabulary-wide computation. However, we show that t
Stay posted· Newsletter
Three short emails a week: Monday, Wednesday and Friday. Top movers, new models and the most-referenced story.
Your email is used only to send The Bubble Brief. Privacy policy
Discussion
No replies yet. Be first.
Related coverage
More from ARXIV
arxivAn AI Security Agent for University ACMIS: Multi-Vector Threat Detection and Automated Response9harxivLearning Transferable Latent User Preferences for Human-Aligned Decision Making9harxivRepair the Core, Not the Symptom: Planning-Graph Repair for Long-Horizon Agents9harxivIndustryForge-27B: A Domain-Enhanced Multimodal Foundation Model for Industrial CAD9hThe Bubble Brief
MON · WED · FRIRead AI insights every Monday, Wednesday and Friday — top movers, new models, story of the week.
Your email is used only to send The Bubble Brief. Privacy policy
Originally published on arxiv ↗