arxiv
PublishedNovember 4, 2026 at 5:00 AM
Label Smoothing in Disguise? Gated Knowledge Distillation for Low-Resource Bangla Generation
Publisher summary· verbatim
arXiv:2611.01065v1 Announce Type: new Abstract: Gated knowledge distillation (KD) weights teacher signals per token or example, aiming to trust an imperfect teacher only where it seems reliable. We test two gates: EWAD (entropy-weighted agreement-aware distillation), which gates tokens by teacher co
Stay posted· Newsletter
Three short emails a week: Monday, Wednesday and Friday. Top movers, new models and the most-referenced story.
Your email is used only to send The Bubble Brief. Privacy policy
Discussion
No replies yet. Be first.
Related coverage
More from ARXIV
arxivFrom Fragmentation to Fusion: A Survey and Roadmap for Omnimodal Embeddings14harxivFidelity Collapses with Table Size, Not Turn Count: Delivery Architecture in a Deployed Tool-Using Agent14harxivFrom Lookups to Lessons: Turning Retrieved Knowledge into Parametric Memory14harxivSteering Readerly Dynamics: Trajectory-Guided Story Generation with Large Language Models14hThe Bubble Brief
MON · WED · FRIRead AI insights every Monday, Wednesday and Friday — top movers, new models, story of the week.
Your email is used only to send The Bubble Brief. Privacy policy
Originally published on arxiv ↗