arxiv
PublishedOctober 22, 2026 at 4:00 AM
How to Use Parallel Data for Multilingual Pretraining
Publisher summary· verbatim
arXiv:2610.28838v1 Announce Type: new Abstract: High-quality human-translated parallel corpora can improve cross-lingual transfer, but are typically too small for large-scale pretraining. Machine-translated web corpora help overcome this limitation, making parallel data available at pretraining scal
Stay posted· Newsletter
Three short emails a week: Monday, Wednesday and Friday. Top movers, new models and the most-referenced story.
Your email is used only to send The Bubble Brief. Privacy policy
Discussion
No replies yet. Be first.
Related coverage
More from ARXIV
arxivRetrieval Augmented Generation Compositionality7harxivEvolving with Open Worlds: Towards Recursive Self-Improvement for Future Forecasting7harxivTowards English - Mizo Legal Machine Translation: Corpus Creation, Analysis, and Benchmarks7harxivVeriEvolve: Evaluator-First Evolution for Tool-Using Agents7hThe Bubble Brief
MON · WED · FRIRead AI insights every Monday, Wednesday and Friday — top movers, new models, story of the week.
Your email is used only to send The Bubble Brief. Privacy policy
Originally published on arxiv ↗