arxiv
PublishedApril 4, 2026 at 4:00 AM
▲bullish
Countering Catastrophic Forgetting of Large Language Models for Better Instruction Following via Weight-Space Model Merging
Publisher summary· verbatim
arXiv:2604.01538v1 Announce Type: new Abstract: Large language models have been adopted in the medical domain for clinical documentation to reduce clinician burden. However, studies have reported that LLMs often "forget" a significant amount of instruction-following ability when fine-tuned using a t
Models mentioned
01Related
04- arxivMay 28A Benchmark Construction and Evaluation Framework for Specialist Domains: Case Study on Defense-related Documents
- arxivMay 22GraphRAG on Consumer Hardware: Benchmarking Local LLMs for Healthcare EHR Schema Retrieval
- arxivMay 22DrugRAG: Enhancing Pharmacy LLM Performance Through A Novel Retrieval-Augmented Generation Pipeline
- arxivMay 8Measuring Evaluation-Context Divergence in Open-Weight LLMs: A Paired-Prompt Protocol with Pilot Evidence of Alignment-Pipeline-Specific Heterogeneity
Stay posted· Newsletter
Three short emails a week: Monday, Wednesday and Friday. Top movers, new models and the most-referenced story.
Your email is used only to send The Bubble Brief. Privacy policy
Discussion
No replies yet. Be first.
Related coverage
More from ARXIV
arxivA Theoretical Analysis of Test-Driven Code Generation11harxivScalable Adaptation of 3D Geometric Foundation Models via Weak Supervision from Internet Video11harxivCan Graph Learning Learn Circuits?11harxivBeyond Fixed Acquisition Functions: Temporal Difference Active Learning for Perturbation Discovery11hThe Bubble Brief
MON · WED · FRIRead open-source insights every Monday, Wednesday and Friday — top movers, new models, story of the week.
Your email is used only to send The Bubble Brief. Privacy policy
Originally published on arxiv ↗