·
DataBubble
  • Home
  • Models
  • News
  • Compare
  • Boards
  • Pricing
  • About
  • Newsletter
  • Methodology
  • Contact
Latest
Ensemble forecasting with IBM Granite time-series models1h◆How to Use Parallel Data for Multilingual Pretraining5h◆KIRA: A Full-Stack Reading Screening System with Dual-Pathway Analysis for Children5h◆Building AI Research Teams for Autonomous Discovery of Linear Attention Architectures5h◆CSD: Common-Support Distillation for Cross-Tokenizer Knowledge Transfer5h◆Is Refusal Direction Universal across Low-Resourced Languages?5h◆Guilt by Association: Semantic Leakage Drives Associative Gender Bias5h◆Scan or Index? large Evidence Coverage, Answer Quality, and Cost in Long-Document RAG5h◆Language Impairment as a Lens onto Large Language Models5h◆Target Regeneration Shrinks the Gains of Draft-Training Objectives in Speculative Decoding5h◆Credit Where Credit Is Due: Contrastive Attribution Topology Search for Multi-Agent Systems5h◆Asking What a Director Sees Can Change What Vision-Language Models Choose5h◆A KAN-based Non-linear Factorization for Embedding Layer Compression5h◆Keeping Time vs. Understanding Time: Neither Alone Explains Temporal Reasoning in LLMs5h◆A Diagnostic Study of Faithfulness in Diffusion Language Models for Table-to-Text Generation5h◆LLMs as survey respondents: Comparison to simple semantic baselines5h◆Scaling Multilingual Pretraining of Pixel Language Models5h◆Retrieval Augmented Generation Compositionality5h◆ALIAS: Evaluating Performance and Memorization in LLM-Written TLA+ Specifications5h◆Evolving with Open Worlds: Towards Recursive Self-Improvement for Future Forecasting5h◆Ensemble forecasting with IBM Granite time-series models1h◆How to Use Parallel Data for Multilingual Pretraining5h◆KIRA: A Full-Stack Reading Screening System with Dual-Pathway Analysis for Children5h◆Building AI Research Teams for Autonomous Discovery of Linear Attention Architectures5h◆CSD: Common-Support Distillation for Cross-Tokenizer Knowledge Transfer5h◆Is Refusal Direction Universal across Low-Resourced Languages?5h◆Guilt by Association: Semantic Leakage Drives Associative Gender Bias5h◆Scan or Index? large Evidence Coverage, Answer Quality, and Cost in Long-Document RAG5h◆Language Impairment as a Lens onto Large Language Models5h◆Target Regeneration Shrinks the Gains of Draft-Training Objectives in Speculative Decoding5h◆Credit Where Credit Is Due: Contrastive Attribution Topology Search for Multi-Agent Systems5h◆Asking What a Director Sees Can Change What Vision-Language Models Choose5h◆A KAN-based Non-linear Factorization for Embedding Layer Compression5h◆Keeping Time vs. Understanding Time: Neither Alone Explains Temporal Reasoning in LLMs5h◆A Diagnostic Study of Faithfulness in Diffusion Language Models for Table-to-Text Generation5h◆LLMs as survey respondents: Comparison to simple semantic baselines5h◆Scaling Multilingual Pretraining of Pixel Language Models5h◆Retrieval Augmented Generation Compositionality5h◆ALIAS: Evaluating Performance and Memorization in LLM-Written TLA+ Specifications5h◆Evolving with Open Worlds: Towards Recursive Self-Improvement for Future Forecasting5h◆
News/GaP-MoE : Explicit Expert Specialization in Mixture-of-Experts via Orthogonal Gradient Accumulation and Projection
arxiv
PublishedOctober 22, 2026 at 4:00 AM

GaP-MoE : Explicit Expert Specialization in Mixture-of-Experts via Orthogonal Gradient Accumulation and Projection

Source
arxiv.orgfull article ↗
Read on arxiv→
Publisher summary· verbatim

arXiv:2610.29355v1 Announce Type: new Abstract: Sparse Mixture-of-Experts (SMoE) models improve scalability by routing input tokens to only a subset of expert networks, but they often suffer from representation collapse, in which multiple experts converge toward similar functions and lose their inte

Stay posted· Newsletter

Three short emails a week: Monday, Wednesday and Friday. Top movers, new models and the most-referenced story.

// no spam · unsubscribe one-click · free forever

Your email is used only to send The Bubble Brief. Privacy policy

Discussion
Source
↗
arxiv
Read original ↗All from arxiv →

No replies yet. Be first.

Source
↗
arxiv
Read original ↗All from arxiv →

Related coverage

More from ARXIV
arxivHow to Use Parallel Data for Multilingual Pretraining5harxivKIRA: A Full-Stack Reading Screening System with Dual-Pathway Analysis for Children5harxivBuilding AI Research Teams for Autonomous Discovery of Linear Attention Architectures5harxivCSD: Common-Support Distillation for Cross-Tokenizer Knowledge Transfer5h
The Bubble Brief
MON · WED · FRI

Read AI insights every Monday, Wednesday and Friday — top movers, new models, story of the week.

// no spam · unsubscribe one-click · free forever

Your email is used only to send The Bubble Brief. Privacy policy

Originally published on arxiv ↗
PrivacyTermsRefundsLegal notice|AboutMethodologyContact

© 2026 Databubble

Built by Marouane Gazouzi · Readyo, AI interview coach

HomeModelsNews