·
DataBubble
  • Home
  • Models
  • News
  • Compare
  • Boards
  • Pricing
  • About
  • Newsletter
  • Methodology
  • Contact
Latest
SpaceX IPO: Live updates on everything you need to know3h◆Meta’s months-old AI unit is a soul-crushing gulag, say the engineers stuck inside it3h◆Chinese cybercrime operation that used AI to scam ‘hundreds of thousands of victims’ sued by Google5h◆Mistral is rumored to be raising €3B at €20B valuation8h◆Siri is good now??9h◆Elon Musk is the world’s first trillionaire10h◆SpaceX, Anthropic, and OpenAI’s hot IPO summer10h◆olmo-eval: An evaluation workbench for the model development loop10h◆It’s hot IPO summer, and the MANGOS are ripe10h◆SpaceX’s massive IPO: all the latest news11h◆Jeff Bezos’ AI startup aims to build an ‘artificial general engineer’12h◆New OpenAI Academy courses for the next era of work16h◆Siri won’t be your AI girlfriend19h◆Cheaper, faster, and culturally aware, Avataar’s video AI is built for India’s scale21h◆EDEN: A Large-Scale Corpus of Clinical Notes for Italian22h◆ASTER: Latent Pseudo-Anomaly Generation for Unsupervised Time-Series Anomaly Detection22h◆LoHoSearch: Benchmarking Long-Horizon Search Agents Beyond the Human Difficulty Ceiling22h◆Projected random forests and conformal prediction of circular data22h◆APPO: Agentic Procedural Policy Optimization22h◆ALIGNBEAM : Inference-Time Alignment Transfer via Cross-Vocabulary Logit Mixing22h◆SpaceX IPO: Live updates on everything you need to know3h◆Meta’s months-old AI unit is a soul-crushing gulag, say the engineers stuck inside it3h◆Chinese cybercrime operation that used AI to scam ‘hundreds of thousands of victims’ sued by Google5h◆Mistral is rumored to be raising €3B at €20B valuation8h◆Siri is good now??9h◆Elon Musk is the world’s first trillionaire10h◆SpaceX, Anthropic, and OpenAI’s hot IPO summer10h◆olmo-eval: An evaluation workbench for the model development loop10h◆It’s hot IPO summer, and the MANGOS are ripe10h◆SpaceX’s massive IPO: all the latest news11h◆Jeff Bezos’ AI startup aims to build an ‘artificial general engineer’12h◆New OpenAI Academy courses for the next era of work16h◆Siri won’t be your AI girlfriend19h◆Cheaper, faster, and culturally aware, Avataar’s video AI is built for India’s scale21h◆EDEN: A Large-Scale Corpus of Clinical Notes for Italian22h◆ASTER: Latent Pseudo-Anomaly Generation for Unsupervised Time-Series Anomaly Detection22h◆LoHoSearch: Benchmarking Long-Horizon Search Agents Beyond the Human Difficulty Ceiling22h◆Projected random forests and conformal prediction of circular data22h◆APPO: Agentic Procedural Policy Optimization22h◆ALIGNBEAM : Inference-Time Alignment Transfer via Cross-Vocabulary Logit Mixing22h◆
News/MixSD: Mixed Contextual Self-Distillation for Knowledge Injection
arxiv
PublishedMay 22, 2026 at 4:00 AM
—neutral

MixSD: Mixed Contextual Self-Distillation for Knowledge Injection

Source
arxiv.orgfull article ↗
Read on arxiv→
Publisher summary· verbatim

arXiv:2605.16865v2 Announce Type: replace Abstract: Supervised fine-tuning (SFT) is widely used to inject new knowledge into language models, but it often degrades pretrained capabilities such as reasoning and general-domain performance. We argue this forgetting arises because fine-tuning targets fr

Stay posted· Newsletter

A 5-min weekly brief — top movers, price watch, story of the week.

// no spam · unsubscribe one-click · free forever

Discussion
Source
↗
arxiv
Read original ↗All from arxiv →

No replies yet. Be first.

Source
↗
arxiv
Read original ↗All from arxiv →

Related coverage

More from ARXIV
arxivEDEN: A Large-Scale Corpus of Clinical Notes for Italian22harxivASTER: Latent Pseudo-Anomaly Generation for Unsupervised Time-Series Anomaly Detection22harxivLoHoSearch: Benchmarking Long-Horizon Search Agents Beyond the Human Difficulty Ceiling22harxivProjected random forests and conformal prediction of circular data22h
The Bubble Brief
WEEKLY

Read AI insights every Tuesday — top movers, new releases, story of the week.

// no spam · unsubscribe one-click · free forever

Originally published on arxiv ↗
HomeModelsNews