arxiv
PublishedJuly 3, 2026 at 4:00 AM
HERMES: A Multi-Granularity Labeling Substrate for Pre-training Data Mixtures
Publisher summary· verbatim
arXiv:2607.02266v1 Announce Type: cross Abstract: Most data-mixing methods assume the corpus has already been partitioned into groups, and the choice of those groups determines what a mixer can express. Existing labels, including provenance, topic or format taxonomies, and flat embedding clusters, c
Stay posted· Newsletter
Three short emails a week: Monday, Wednesday and Friday. Top movers, new models and the most-referenced story.
Your email is used only to send The Bubble Brief. Privacy policy
Discussion
No replies yet. Be first.
Related coverage
More from ARXIV
arxivAn AI Security Agent for University ACMIS: Multi-Vector Threat Detection and Automated Response26marxivNavalia: Advancing Cowork Agents through Verifiable Task Synthesis and Long-Horizon Post-Training26marxivLarge language model and reinforcement learning based autonomous construction and progress updates26marxivPareto-Optimal RTL Code Generation via Multi-Objective Reinforcement Learning with Large Language Models26mThe Bubble Brief
MON · WED · FRIRead AI insights every Monday, Wednesday and Friday — top movers, new models, story of the week.
Your email is used only to send The Bubble Brief. Privacy policy
Originally published on arxiv ↗