arxivJul 21bullish

Masked Diffusion Language Models are Strong and Steerable Text-Based World Models for Agentic RL

arXiv:2607.16204v1 Announce Type: new Abstract: Recent growth in reinforcement learning (RL) has surfaced a need for diverse, specialized training environments. Hand-curated environments with fixed task and reward difficulties become ineffective signals as model performance improves, and sparse rewa

LLMDLF5 models · +2 #reinforcement-learning #world-models

arxivJun 3bullish

Your Autoregressive Model Already Reveals the Causal Graph

arXiv:2602.01135v3 Announce Type: replace Abstract: Autoregressive models trained via next-token prediction implicitly learn the conditional independence structure of their data-generating process. We exploit this observation to perform scalable causal discovery from a single observed sequence of di

TR1 model #causal-discovery #autoregressive-models #sequence-prediction Read on arxiv →

arxivMay 28

Compositional Generalization in Autoregressive Models via Logit Composition

arXiv:2605.28304v1 Announce Type: new Abstract: Composing autoregressive models remains a core challenge in understanding how large language models can combine behaviors or skills learned across tasks. We introduce a new and principled composition strategy for autoregressive systems, inspired by com

#machine-learning #autoregressive-models #diffusion-models Read on arxiv →