·
DataBubble
  • Home
  • Models
  • News
  • Compare
  • Boards
  • Pricing
  • About
  • Newsletter
  • Methodology
  • Contact
Latest
Ensemble forecasting with IBM Granite time-series models2h◆How to Use Parallel Data for Multilingual Pretraining5h◆KIRA: A Full-Stack Reading Screening System with Dual-Pathway Analysis for Children5h◆Building AI Research Teams for Autonomous Discovery of Linear Attention Architectures5h◆CSD: Common-Support Distillation for Cross-Tokenizer Knowledge Transfer5h◆Is Refusal Direction Universal across Low-Resourced Languages?5h◆Guilt by Association: Semantic Leakage Drives Associative Gender Bias5h◆Scan or Index? large Evidence Coverage, Answer Quality, and Cost in Long-Document RAG5h◆Language Impairment as a Lens onto Large Language Models5h◆Target Regeneration Shrinks the Gains of Draft-Training Objectives in Speculative Decoding5h◆Credit Where Credit Is Due: Contrastive Attribution Topology Search for Multi-Agent Systems5h◆Asking What a Director Sees Can Change What Vision-Language Models Choose5h◆A KAN-based Non-linear Factorization for Embedding Layer Compression5h◆Keeping Time vs. Understanding Time: Neither Alone Explains Temporal Reasoning in LLMs5h◆A Diagnostic Study of Faithfulness in Diffusion Language Models for Table-to-Text Generation5h◆LLMs as survey respondents: Comparison to simple semantic baselines5h◆Scaling Multilingual Pretraining of Pixel Language Models5h◆Retrieval Augmented Generation Compositionality5h◆ALIAS: Evaluating Performance and Memorization in LLM-Written TLA+ Specifications5h◆Evolving with Open Worlds: Towards Recursive Self-Improvement for Future Forecasting5h◆Ensemble forecasting with IBM Granite time-series models2h◆How to Use Parallel Data for Multilingual Pretraining5h◆KIRA: A Full-Stack Reading Screening System with Dual-Pathway Analysis for Children5h◆Building AI Research Teams for Autonomous Discovery of Linear Attention Architectures5h◆CSD: Common-Support Distillation for Cross-Tokenizer Knowledge Transfer5h◆Is Refusal Direction Universal across Low-Resourced Languages?5h◆Guilt by Association: Semantic Leakage Drives Associative Gender Bias5h◆Scan or Index? large Evidence Coverage, Answer Quality, and Cost in Long-Document RAG5h◆Language Impairment as a Lens onto Large Language Models5h◆Target Regeneration Shrinks the Gains of Draft-Training Objectives in Speculative Decoding5h◆Credit Where Credit Is Due: Contrastive Attribution Topology Search for Multi-Agent Systems5h◆Asking What a Director Sees Can Change What Vision-Language Models Choose5h◆A KAN-based Non-linear Factorization for Embedding Layer Compression5h◆Keeping Time vs. Understanding Time: Neither Alone Explains Temporal Reasoning in LLMs5h◆A Diagnostic Study of Faithfulness in Diffusion Language Models for Table-to-Text Generation5h◆LLMs as survey respondents: Comparison to simple semantic baselines5h◆Scaling Multilingual Pretraining of Pixel Language Models5h◆Retrieval Augmented Generation Compositionality5h◆ALIAS: Evaluating Performance and Memorization in LLM-Written TLA+ Specifications5h◆Evolving with Open Worlds: Towards Recursive Self-Improvement for Future Forecasting5h◆
News/Don't Stop Long-Context Continual Pre-Training Too Early: An Empirical Scaling Law
arxiv
PublishedOctober 22, 2026 at 4:00 AM

Don't Stop Long-Context Continual Pre-Training Too Early: An Empirical Scaling Law

Source
arxiv.orgfull article ↗
Read on arxiv→
Publisher summary· verbatim

arXiv:2610.29352v1 Announce Type: new Abstract: Long-context continual pre-training (LCCP) is widely used to improve long-context capability, but how its benefits scale with the number of tokens used for LCCP remains unclear. We investigate this question through modeling, monitoring, and validating

Stay posted· Newsletter

Three short emails a week: Monday, Wednesday and Friday. Top movers, new models and the most-referenced story.

// no spam · unsubscribe one-click · free forever

Your email is used only to send The Bubble Brief. Privacy policy

Discussion
Source
↗
arxiv
Read original ↗All from arxiv →

No replies yet. Be first.

Source
↗
arxiv
Read original ↗All from arxiv →

Related coverage

More from ARXIV
arxivHow to Use Parallel Data for Multilingual Pretraining5harxivKIRA: A Full-Stack Reading Screening System with Dual-Pathway Analysis for Children5harxivBuilding AI Research Teams for Autonomous Discovery of Linear Attention Architectures5harxivCSD: Common-Support Distillation for Cross-Tokenizer Knowledge Transfer5h
The Bubble Brief
MON · WED · FRI

Read AI insights every Monday, Wednesday and Friday — top movers, new models, story of the week.

// no spam · unsubscribe one-click · free forever

Your email is used only to send The Bubble Brief. Privacy policy

Originally published on arxiv ↗
PrivacyTermsRefundsLegal notice|AboutMethodologyContact

© 2026 Databubble

Built by Marouane Gazouzi · Readyo, AI interview coach

HomeModelsNews