·
DataBubble
  • Home
  • Models
  • News
  • Compare
  • Boards
  • Pricing
  • About
  • Newsletter
  • Methodology
  • Contact
Latest
MAGNET: Manifold-Aware Graph Diffusion Network for Connectome Generation1h◆Counterfactual Model Testing Under Distribution Shift1h◆Centralized Critics for N-Agent Ad Hoc Teamwork1h◆Where and What to Reward? Understanding Generalization Between Verifiable and Open-Ended Domains in Reinforcement Learning1h◆Fast KVzip: Efficient and Accurate LLM Inference with Gated KV Eviction1h◆Numina Fuse: Interactive Autoformalization in Lean 41h◆On the Limits of Sparse Linear Model with Shuffled Differential Privacy1h◆Video World Models Need Predictable Latents1h◆AutoPRL: Automated Path Representation Learning via a Learnable View Generator1h◆Beyond Reasoning Gains: Mitigating General-Capability Forgetting in Large Reasoning Models1h◆Latent Goal Prediction from Language for Model-Based Planning1h◆Rectified Language Flow1h◆Trainable Boundary-Keeping Where No Formal Answer Exists: A Controlled Knock-In Study of Reward Training in Evidence-Sufficiency Judgment1h◆Intrinsic Goals for Autonomous Agents: Hierarchical Exploration Captures Future Volitional Action in Drosophila1h◆Estimating Long-term Heterogeneous Dose-response Curve: Generalization Bound Leveraging Optimal Transport Weights1h◆Intervention-Certified Amplification: A Validity Gate for $\sigma$-Weighted Post-Training1h◆Single-Cycle Battery Remaining Useful Life Prediction with Compressed Continuous Wavelet Features and Deep Neural Networks1h◆DoubleFree:Exploiting Exploration History for Rollout-Free Multi-Task LLMs Training1h◆Unbiased Alignment for Large Language Models with Noisy Preferences1h◆ExCal: Optimization-Free Multivariate Time Series Anomaly Detection via Excess Calibration1h◆MAGNET: Manifold-Aware Graph Diffusion Network for Connectome Generation1h◆Counterfactual Model Testing Under Distribution Shift1h◆Centralized Critics for N-Agent Ad Hoc Teamwork1h◆Where and What to Reward? Understanding Generalization Between Verifiable and Open-Ended Domains in Reinforcement Learning1h◆Fast KVzip: Efficient and Accurate LLM Inference with Gated KV Eviction1h◆Numina Fuse: Interactive Autoformalization in Lean 41h◆On the Limits of Sparse Linear Model with Shuffled Differential Privacy1h◆Video World Models Need Predictable Latents1h◆AutoPRL: Automated Path Representation Learning via a Learnable View Generator1h◆Beyond Reasoning Gains: Mitigating General-Capability Forgetting in Large Reasoning Models1h◆Latent Goal Prediction from Language for Model-Based Planning1h◆Rectified Language Flow1h◆Trainable Boundary-Keeping Where No Formal Answer Exists: A Controlled Knock-In Study of Reward Training in Evidence-Sufficiency Judgment1h◆Intrinsic Goals for Autonomous Agents: Hierarchical Exploration Captures Future Volitional Action in Drosophila1h◆Estimating Long-term Heterogeneous Dose-response Curve: Generalization Bound Leveraging Optimal Transport Weights1h◆Intervention-Certified Amplification: A Validity Gate for $\sigma$-Weighted Post-Training1h◆Single-Cycle Battery Remaining Useful Life Prediction with Compressed Continuous Wavelet Features and Deep Neural Networks1h◆DoubleFree:Exploiting Exploration History for Rollout-Free Multi-Task LLMs Training1h◆Unbiased Alignment for Large Language Models with Noisy Preferences1h◆ExCal: Optimization-Free Multivariate Time Series Anomaly Detection via Excess Calibration1h◆
Source

arXiv

100 articles indexed from arXiv

arxiv1h ago

MAGNET: Manifold-Aware Graph Diffusion Network for Connectome Generation

arXiv:2610.17014v2 Announce Type: replace Abstract: Functional brain connectome represents neural connectivity as a matrix of pairwise interactions between brain regions. Generation of functional connectomes is not only a question of validity; rather, having satisfied the constraints on the correlat

Read on arxiv →
arxiv1h ago

Counterfactual Model Testing Under Distribution Shift

arXiv:2610.33594v1 Announce Type: cross Abstract: Deployed machine learning (ML) models can degrade as the distribution of their input data shifts. Such shifts can result from changes in the population or from data integrity issues in the pipeline that materializes model features, two sources that o

Read on arxiv →
arxiv1h ago

Centralized Critics for N-Agent Ad Hoc Teamwork

arXiv:2610.34799v1 Announce Type: cross Abstract: Centralized training with decentralized execution (CTDE) has become the dominant paradigm in multi-agent reinforcement learning (MARL), motivating extensive study of what privileged information should be made available to the critic during training.

Read on arxiv →
arxiv1h ago

Where and What to Reward? Understanding Generalization Between Verifiable and Open-Ended Domains in Reinforcement Learning

arXiv:2605.15464v2 Announce Type: replace Abstract: Reinforcement learning with verifiable rewards (RLVR) is widely used to improve the reasoning capability of language models, since model-generated answers can be easily verified by a rule-based verifier. In contrast, reinforcement learning from hum

Read on arxiv →
arxiv1h ago

Fast KVzip: Efficient and Accurate LLM Inference with Gated KV Eviction

arXiv:2601.17668v3 Announce Type: replace Abstract: Efficient key-value (KV) cache management is crucial for the practical deployment of large language models (LLMs), yet existing compression techniques often incur a trade-off between performance degradation and computational overhead. We propose a

Read on arxiv →
arxiv1h ago

Numina Fuse: Interactive Autoformalization in Lean 4

arXiv:2610.33860v1 Announce Type: cross Abstract: Numina Fuse is an agent-native application for formalizing mathematics in Lean 4. Since Lean can compile while not representing its intended informal meaning, and agents now write Lean faster than people can read it, we built Fuse around human superv

Read on arxiv →
arxiv1h ago

On the Limits of Sparse Linear Model with Shuffled Differential Privacy

arXiv:2610.32822v2 Announce Type: replace Abstract: Sparse linear regression is a fundamental problem in high-dimensional statistics, and its private counterparts leave a large gap between the central and the local model of differential privacy. Shuffled differential privacy (SDP) sits between the t

Read on arxiv →
arxiv1h ago

Video World Models Need Predictable Latents

arXiv:2610.34663v1 Announce Type: new Abstract: Video world models trained on large-scale robot data promise a safe and scalable approach for learning and evaluating policies that act in the physical world. However, they still struggle with long-horizon rollouts and out-of-distribution generalizatio

Read on arxiv →
arxiv1h ago

AutoPRL: Automated Path Representation Learning via a Learnable View Generator

arXiv:2610.35032v1 Announce Type: new Abstract: Self-supervised learning has emerged as a powerful paradigm for Path Representation Learning (PRL) in road networks. PRL aims to learn informative representations of paths traversed by moving objects, such as vehicles, where each path consists of a seq

Read on arxiv →
arxiv1h ago

Beyond Reasoning Gains: Mitigating General-Capability Forgetting in Large Reasoning Models

arXiv:2510.21978v3 Announce Type: replace Abstract: Reinforcement learning with verifiable rewards (RLVR) has delivered impressive gains in mathematical and multimodal reasoning and has become a standard post-training paradigm for contemporary language and vision-language models. However, the RLVR r

Read on arxiv →
arxiv1h ago

Latent Goal Prediction from Language for Model-Based Planning

arXiv:2606.20627v3 Announce Type: replace-cross Abstract: Joint-Embedding Predictive Architectures (JEPAs) enable agents to plan in latent space by imagining the outcomes of candidate actions, yet task specification remains a bottleneck. Visual targets provide precise local gradients but poor distan

Read on arxiv →
arxiv1h ago

Rectified Language Flow

arXiv:2610.33811v1 Announce Type: cross Abstract: Continuous-state flow and diffusion models offer a promising approach to fast, parallel language generation, but matching the generation quality of autoregressive models remains challenging. We present Rectified Language Flow (ReLF), a language model

Read on arxiv →
arxiv1h ago

Trainable Boundary-Keeping Where No Formal Answer Exists: A Controlled Knock-In Study of Reward Training in Evidence-Sufficiency Judgment

arXiv:2610.35226v1 Announce Type: cross Abstract: Reasoning-tuned and reward-trained models are often assumed to verify more reliably because they reason longer or receive correctness signals. We test this in evidence-sufficiency judgment: deciding whether available information actually supports a c

Read on arxiv →
arxiv1h ago

Intrinsic Goals for Autonomous Agents: Hierarchical Exploration Captures Future Volitional Action in Drosophila

arXiv:2610.34638v1 Announce Type: cross Abstract: Animals have a remarkable capacity for autonomy---driven by intrinsic motivation---without external sensory cues or extrinsic objectives, yet the computational mechanisms behind this ability largely remain a mystery. We combine whole-brain recordings

Read on arxiv →
arxiv1h ago

Estimating Long-term Heterogeneous Dose-response Curve: Generalization Bound Leveraging Optimal Transport Weights

arXiv:2406.19195v4 Announce Type: replace Abstract: Long-term treatment effect estimation is a significant but challenging problem in many applications. Existing methods rely on ideal assumptions, such as no unobserved confounders or binary treatment, to estimate long-term average treatment effects.

Read on arxiv →
arxiv1h ago

Intervention-Certified Amplification: A Validity Gate for $\sigma$-Weighted Post-Training

arXiv:2610.33882v1 Announce Type: new Abstract: Hybrid post-training often mixes supervised fine-tuning (SFT) and reinforcement learning (RL), using training-side signals to set each sample's balance. Such signals characterize the anchor data and policy, but not whether the emphasized behavior helps

Read on arxiv →
arxiv1h ago

Single-Cycle Battery Remaining Useful Life Prediction with Compressed Continuous Wavelet Features and Deep Neural Networks

arXiv:2610.34159v1 Announce Type: new Abstract: Lithium-ion batteries are widely used in industrial applications, but their performance gradually degrades over time, making accurate lifetime prediction important for safety and reliability. However, reliable lifetime assessment generally requires ext

Read on arxiv →
arxiv1h ago

DoubleFree:Exploiting Exploration History for Rollout-Free Multi-Task LLMs Training

arXiv:2610.34272v1 Announce Type: new Abstract: Multi-task post-training can develop domain specialists through independent reinforcement learning (RL) and consolidate their capabilities through multi-teacher on-policy distillation (MOPD). However, standard MOPD generates on-policy student responses

Read on arxiv →
arxiv1h ago

Unbiased Alignment for Large Language Models with Noisy Preferences

arXiv:2607.03248v2 Announce Type: replace Abstract: The alignment of large language models with human preferences is commonly achieved through Reinforcement Learning from Human Feedback or Direct Preference Optimization. However, these methods are vulnerable to the significant noise prevalent in rea

Read on arxiv →
arxiv1h ago

ExCal: Optimization-Free Multivariate Time Series Anomaly Detection via Excess Calibration

arXiv:2610.35568v1 Announce Type: new Abstract: We introduce ExCal, a normal-only multivariate time series anomaly detector that combines raw state retrieval, a signal/derivative subspace, and robust statistics across temporal scales. Each expert map receives a high normality floor from the training

Read on arxiv →
arxiv1h ago

DialFork: Going Beyond Factuality to Evaluate Procedural Hallucination in Conversational Agents

arXiv:2610.21561v4 Announce Type: replace-cross Abstract: Large language models (LLMs) deployed as conversational agents are increasingly expected to follow procedural logic. While factual hallucination has received extensive attention, a different failure mode has been overlooked: procedural halluc

Read on arxiv →
arxiv1h ago

Self-Supervised Pretraining for PHM: What Transfers, What Does Not, and What Federating It Costs

arXiv:2610.35280v1 Announce Type: cross Abstract: Self-supervised pretraining has produced capable time-series foundation models, but its value for Prognostics and Health Management (PHM) has not been measured under leakage-controlled conditions. We measure it on a corpus of 47 public PHM datasets,

Read on arxiv →
arxiv1h ago

Improving the Performance of Compressed Transformers with Post-Hoc Embedding Alignment

arXiv:2602.14635v2 Announce Type: replace Abstract: Model compression is necessary for deployment of transformer models in resource-constrained environments. However, compression reduces the performance of transformer models on downstream tasks. Existing solutions such as Knowledge Distillation (KD)

Read on arxiv →
arxiv1h ago

AdaptTok-Indic: Script-Aware Adaptive Tokenization for Indic Languages

arXiv:2610.33017v1 Announce Type: cross Abstract: Multilingual tokenizers trained on English-dominated corpora often over-segment Indic languages, resulting in longer token sequences and increased tokenization disparity across scripts. We present AdaptTok-Indic, an Indic-specialized extension of ada

Read on arxiv →
arxiv1h ago

EviGround-CT: Sentence-to-Volume Grounding for Verifying LLM-Generated Chest CT Reports

arXiv:2610.33038v1 Announce Type: cross Abstract: Chest computed tomography (CT) reports generated by large language models (LLMs) can describe positive findings that lack localized evidence in the scan. We propose EviGround-CT to verify these findings after report generation. A deterministic extrac

Read on arxiv →
arxiv1h ago

Multivariate Time Series Forecasting needs Cross Variable Loss

arXiv:2608.05742v4 Announce Type: replace Abstract: Multivariate time series forecasting presents unique challenges because future variables often co-evolve under shared system dynamics. While existing studies mainly focus on cross-variable dependencies in historical observations, dependencies among

Read on arxiv →
arxiv1h ago

Bayesian Optimization with Fisher Information Geometry: Gradient Bounds and Trust-Region Methods

arXiv:2609.31107v2 Announce Type: replace Abstract: We study Bayesian optimization (BO) through the lens of information geometry. Pulling back the Fisher information metric through the surrogate posterior map yields a local sensitivity tensor on the input space, which leads to an upper bound on the

Read on arxiv →
arxiv1h ago

Harness Scaling for Generalizable Agentic Reinforcement Learning

arXiv:2610.29458v2 Announce Type: replace Abstract: Agent harnesses have become a central component of modern agentic systems, shaping how models use tools, manage context, and coordinate long-horizon interaction. Realizing the benefits of these harnesses depends on how effectively the underlying mo

Read on arxiv →
arxiv1h ago

Recovering Black-Box Point Cloud Models from Pose Shifts via Derivative-Free Optimization

arXiv:2610.34850v1 Announce Type: cross Abstract: Point cloud models are increasingly deployed through score-only black-box interfaces. Under this access model, test-time rotations outside the training distribution can substantially degrade performance. Although existing mitigations such as equivari

Read on arxiv →
arxiv1h ago

LE-GDA: Layer Ensemble Gaussian Discriminant Analysis for Training-Free Few-Shot CLIP Adaptation

arXiv:2610.34901v1 Announce Type: cross Abstract: Training-free few-shot adaptation of vision-language models typically constructs a classifier from CLIP's final projected image representation, leaving intermediate representations unused. Combining them is not straightforward. Class scores from diff

Read on arxiv →
arxiv1h ago

Recovering Wasted Compute in Autoresearch Agents

arXiv:2608.10424v2 Announce Type: replace-cross Abstract: A slew of recent works develop agents for solving research problems end-to-end, a paradigm increasingly referred to as autoresearch. Such agents have inspired large industry investment, motivated by their potential to automate time-consuming

Read on arxiv →
arxiv1h ago

Discovering and Reasoning of Causality in the Hidden World with Large Language Models

arXiv:2402.03941v4 Announce Type: replace Abstract: Revealing hidden causal variables alongside the underlying causal mechanisms is essential to the development of science. Despite the progress in the past decades, existing practice in causal discovery (CD) heavily relies on high-quality measured va

Read on arxiv →
arxiv1h ago

UTA: Universal Training Adaptive Learning Rate Decay

arXiv:2610.35113v1 Announce Type: new Abstract: Learning rate decay (LRD) is critical for training high-performance models, yet most designs remain empirically driven. Although the Universal Budget Aware (UBA) LRD offers a theoretical framework, its reliance on SGD dynamics limits its applicability

Read on arxiv →
arxiv1h ago

$\xi$-DPO: Direct Preference Optimization via Ratio Reward Margin

arXiv:2605.10981v2 Announce Type: replace Abstract: Reference-free preference optimization has emerged as an efficient alternative to reinforcement learning from human feedback, with Simple Preference Optimization(SimPO) demonstrating strong performance by eliminating the explicit reference model th

Read on arxiv →
arxiv1h ago

FediLoRA: Practical Federated Fine-Tuning of Foundation Models Under Missing-Modality Constraints

arXiv:2509.06984v4 Announce Type: replace Abstract: Federated Learning with LoRA fine-tuning offers an efficient and privacy-aware solution for institutions to collaboratively leverage their large datasets to train VLLMs. However, participating institutions often possess heterogeneous computational

Read on arxiv →
arxiv1h ago

CAMEL-CLIP: Channel-aware Multimodal Electroencephalography-text Alignment for Generalizable Brain Foundation Models

arXiv:2603.13272v2 Announce Type: replace Abstract: Electroencephalography (EEG) foundation models have shown promise for learning generalizable representations, yet they remain sensitive to channel heterogeneity, such as changes in channel composition or ordering. We propose channel-aware multimoda

Read on arxiv →
arxiv1h ago

Mathematical Reasoning via Intervention-Based Time-Series Causal Discovery Using LLMs as Concept Mastery Simulators

arXiv:2605.07600v2 Announce Type: replace Abstract: Recent methods for improving LLM mathematical reasoning, whether through MCTS-based test-time search or causal graph-guided knowledge injection, cannot identify which concepts causally contribute to a correct answer, as the observed association may

Read on arxiv →
arxiv1h ago

CANDOR: Chance-Calibrated Neighborhood Discordance in Frozen Encoders for Medical Imaging

arXiv:2607.18451v4 Announce Type: replace Abstract: In medical imaging, one frozen foundation encoder is often reused for many tasks. The encoder is usually chosen by the area under the receiver operating characteristic curve (AUROC) of a head trained on its features. The AUROC does not measure whet

Read on arxiv →
arxiv1h ago

EvoBench: An Evolving, Diagnostic Benchmark Framework for Environmental Modeling

arXiv:2610.35464v1 Announce Type: cross Abstract: Machine learning models are now widely used to predict environmental variable dynamics in domains like hydrology, climate science, agriculture, and ecology. These models are usually compared on fixed benchmark datasets using a single average accuracy

Read on arxiv →
arxiv1h ago

TRIAGE: Efficient Vision-Language-Action Inference Needs Both Reuse and Pruning

arXiv:2610.34519v1 Announce Type: cross Abstract: Vision-language-action (VLA) models are increasingly used for robot manipulation because they map camera images and a language instruction directly to actions. Robots that cannot be tethered to a workstation, such as mobile manipulators and humanoids

Read on arxiv →
arxiv1h ago

Large Language Models: A Plain-Language Overview for Engineers

arXiv:2610.34585v1 Announce Type: cross Abstract: Large language models (LLMs) are neural networks trained on huge text collections to generate text by predicting what comes next. Engineers using ChatGPT and other generative artificial intelligence (AI) tools need a clear picture of what training ch

Read on arxiv →
arxiv1h ago

HARP-LoRA: Hierarchy-Conditioned Rank Projection for Low-Rank Adaptation in Scientific Table Understanding

arXiv:2610.34589v1 Announce Type: cross Abstract: Tabular data is widely used in scientific applications, where complex layouts, including multi-level headers, merged cells, captions, and footnotes, make information extraction difficult. This is particularly important in pharmacokinetics (PK), where

Read on arxiv →
arxiv1h ago

Generative AI in Turbulence: Foundations, Applications, Validations and Benchmarks

arXiv:2610.35123v1 Announce Type: cross Abstract: Generative AI offers new approaches to turbulence problems in which incomplete observations or unresolved d.o.f. admit multiple physically plausible solutions. Potential applications include stochastic closures, super-resolution, data assimilation, u

Read on arxiv →
arxiv1h ago

Multi-Agent Debate for Belief Optimization in Defeasible Domains

arXiv:2605.12718v2 Announce Type: replace-cross Abstract: Multi-agent debate has emerged as a promising approach for improving LLM reasoning on ground-truth tasks, yet current methodologies face certain structural limitations: debate tends to induce a martingale over belief trajectories, majority vo

Read on arxiv →
arxiv1h ago

Measuring Cross-Modal Synergy: A Benchmark for VLM Explainability

arXiv:2605.22168v2 Announce Type: replace-cross Abstract: Vision-Language Models (VLMs) map complex visual inputs to semantic spaces, but interpreting the cross-modal reasoning of VLMs currently relies on post-hoc explainers evaluated via unimodal perturbation metrics. We expose a limitation in this

Read on arxiv →
arxiv1h ago

Improving Reasoning with Rollout Agreement for Group-Based Policy Optimization

arXiv:2610.34951v1 Announce Type: new Abstract: Recent methods for Reinforcement Learning with Verifiable Rewards (RLVR) use rollout diversity to improve reasoning performance or training efficiency. Despite these gains, the extent to which differences among correct-answer rollouts reflect useful al

Read on arxiv →
arxiv1h ago

Subspace Crystallization in Grokking: Rank Compression Tracks the Phase Transition

arXiv:2610.35112v1 Announce Type: new Abstract: Grokking describes understanding something deeply and intuitively. In neural networks, it is the phenomenon where a network generalizes long after memorizing its training data. This delay has been linked to a fall in the effective rank of the network's

Read on arxiv →
arxiv1h ago

Generalized Wasserstein Flow Matching: Nested Couplings for Point Cloud Generation

arXiv:2605.08424v3 Announce Type: replace Abstract: We formulate flow matching on probability measures over probability measures. Directly from the Wasserstein-on-Wasserstein (WoW) continuity equation, we show that admissible nested outer and inner couplings induce a valid metameasure flow and non-l

Read on arxiv →
arxiv1h ago

SHIFT-JEV: Certified Abstention and Gain-Gated Continual Adaptation for LLM-Based Decision Models under Distribution Shift

arXiv:2610.34329v1 Announce Type: new Abstract: Large language models (LLMs) can act as decision models that return a probability distribution over a fixed set of options, but deployed decision models face domain, label-prior, emerging-class and candidate-set shift. We study how such models fail und

Read on arxiv →
arxiv1h ago

Ranking Is Not Deciding: Benchmark Shortcuts and Operating-Point Collapse in Query-Time RAG Poisoning Defenses

arXiv:2610.33849v1 Announce Type: cross Abstract: Query-time filters that screen each retrieved document before it reaches the generator are the dominant published defense against retrieval-augmented generation poisoning, and they report near-perfect detection on domain benchmarks. We show that this

Read on arxiv →
arxiv1h ago

Why Does Structured Output Fail? An Empirical Study of Prompt-Enforced Pydantic Schemas Across Nine LLMs

arXiv:2610.33949v1 Announce Type: cross Abstract: Pipelines that require structured outputs from hosted language models often specify a Pydantic schema in the prompt, validate the response, and retry when validation fails. Although native structured-output modes provide an alternative, application-s

Read on arxiv →
arxiv1h ago

GraphDancer: Training LLMs to Explore and Reason over Graphs via Curriculum Reinforcement Learning

arXiv:2602.02518v3 Announce Type: replace Abstract: Large language models (LLMs) increasingly rely on external knowledge to improve factuality, yet many knowledge sources on the Web, such as scholarly indexes and product catalogs, are organized as heterogeneous graphs. Reasoning over such graph-stru

Read on arxiv →
arxiv1h ago

A False Average: Pooled CoT-Monitor Accuracy Conceals a Reasoning-Dependent Fragility

arXiv:2608.00583v4 Announce Type: replace-cross Abstract: Chain-of-thought (CoT) monitors are reported by their aggregate accuracy on a pool of reward hacks. We show that this number is a false average. On Terminal Wrench, about 77% of hacks are given away by the actions alone, and the monitor's poo

Read on arxiv →
arxiv1h ago

ActTail: Global Activation Sparsity in Large Language Models

arXiv:2603.12272v2 Announce Type: replace-cross Abstract: Activation sparsity is a promising approach for accelerating large language model (LLM) inference by reducing computation and memory movement. However, existing activation sparsity methods typically apply uniform sparsity across projections,

Read on arxiv →
arxiv1h ago

Anatomy of a Scam Call: What 10,000 real scam and spam calls reveal about how phone scammers operate

arXiv:2608.24127v2 Announce Type: replace-cross Abstract: Telephone fraud is pervasive and costly, but its inner workings are rarely observed at scale. We analyze a complete corpus of 10,211 inbound scam and spam calls -- 913 hours of audio and 330,956 transcribed turns from 5,780 distinct numbers -

Read on arxiv →
arxiv1h ago

Cross-Loop Query Handoff: How Later Loops Redirect Two-Hop Retrieval in the Ouro Looped Language Models

arXiv:2610.34639v1 Announce Type: new Abstract: How do later loops in a pretrained looped language model repair two-hop retrieval? We study Ouro-1.4B and Ouro-2.6B by transplanting attention queries between loops at the same layer, head and final prompt position. On synthetic in-context questions, i

Read on arxiv →
arxiv1h ago

Priority-Preserving Advantage Aggregation for Multi-Reward Policy Optimization

arXiv:2610.34862v1 Announce Type: new Abstract: LLM post-training often optimizes multiple objectives with unequal priorities, such as correctness and reasoning efficiency. However, the widely used additive reward aggregation in RL can violate these priorities: when primary and auxiliary advantages

Read on arxiv →
arxiv1h ago

Mechanistic Insights into LoRA: Layer Sparsity for Adaptive Fine-Tuning via Path Patching

arXiv:2610.34756v1 Announce Type: new Abstract: Low-Rank Adaptation (LoRA) has emerged as the dominant paradigm for parameter-efficient fine-tuning of large language models. Standard all-layer LoRA applies adaptation throughout the transformer, despite heterogeneous contributions from its components

Read on arxiv →
arxiv1h ago

AdaPRA: Process Reward Agents with Adaptive Rubrics for Data Science

arXiv:2610.33245v1 Announce Type: cross Abstract: Data science agents can automate end-to-end machine learning workflows, yet they remain far from competitive on human leaderboards. Agents make process errors such as insufficient exploration, unsound validation, coding bugs, and poor use of a fixed

Read on arxiv →
arxiv1h ago

GEMS-RAG: Graph-grounded Engineering Multimodal Standards Retrieval-Augmented Generation

arXiv:2610.33277v1 Announce Type: cross Abstract: Engineering standards are challenging knowledge sources for large language models (LLMs) because they are hierarchical, multimodal, and densely connected through figures, tables, cross-references, and normative rules. Existing retrieval-augmented gen

Read on arxiv →
arxiv1h ago

SkillLifeBench: Benchmarking Security Across the Lifecycle of Agent Skills

arXiv:2610.35215v1 Announce Type: new Abstract: Web agents reuse skills whose stored code, selected version, and loaded implementation can diverge across tasks and updates. SkillLifeBench links these states to task outcomes in 388 paired scenarios spanning implementation, interface, runtime, composi

Read on arxiv →
arxiv1h ago

ProMo3D: Probing Motion Cues in Frozen 3D Foundation Models

arXiv:2610.33802v1 Announce Type: cross Abstract: Feed-forward 3D foundation models have recently reshaped multi-view reconstruction, yet dynamic 4D understanding still often relies on large-scale motion supervision or hand-crafted, architecture-specific heuristics. We ask whether frozen 3D foundati

Read on arxiv →
arxiv1h ago

One Scan is Enough: Demonstration-Free Adaptation for Language-Guided Navigation

arXiv:2610.33794v1 Announce Type: cross Abstract: Deploying a language-guided navigation policy in a new building usually means watching it fail. Public-benchmark VLAs degrade scene by scene as layout, appearance, and language drift, and the standard fix of teleoperating fresh trajectories on site d

Read on arxiv →
arxiv1h ago

AndroidFlux: Evaluating and Reward Modeling Failure Recovery Capabilities in Mobile Use Multimodal Agents

arXiv:2610.34384v1 Announce Type: new Abstract: Mobile-use multimodal agents are typically evaluated by task success from a clean initial state, which does not isolate their ability to recover from intermediate errors. Because mobile environments change dynamically, a general mobile-use agent must c

Read on arxiv →
arxiv1h ago

Outcome-Aware Agents: When Does Causal Structure Help a Forward Model Foresee the Consequences of Actions?

arXiv:2610.34385v1 Announce Type: new Abstract: Agents that act on real systems should predict what their actions will cause before acting. We study when causal structure helps a learned forward model do this, using a planner that rejects candidate actions whose simulated multi-step outcome is unsaf

Read on arxiv →
arxiv1h ago

Correlation-Aware Exploration for Long-Trace Reasoning

arXiv:2610.34949v1 Announce Type: new Abstract: Reasoning models trained with Group Relative Policy Optimization (GRPO) now produce chains of thought thousands of tokens long, and recent studies reveal that such training is prone to policy collapse. Entropy regularization is the standard remedy, but

Read on arxiv →
arxiv1h ago

Beyond Vision-Language Models: Visual-Semantic Affect Graphs for Emotion Recognition in Artworks

arXiv:2610.35244v1 Announce Type: cross Abstract: Emotion recognition in artworks remains challenging because affective meaning is often subjective, implicit, and shaped by relationships between visual form and semantic associations. While vision-language models provide strong multimodal representat

Read on arxiv →
arxiv1h ago

Simple yet Effective Semi-supervised Knowledge Distillation from Vision-Language Models via Dual-Head Optimization

arXiv:2505.07675v3 Announce Type: replace Abstract: Semi-supervised learning (SSL) has emerged as a practical solution for addressing data scarcity challenges by leveraging unlabeled data. Recently, vision-language models (VLMs), pre-trained on massive image-text pairs, have demonstrated remarkable

Read on arxiv →
arxiv1h ago

Fantastic Pretraining Optimizers and Where to Find Them

arXiv:2509.02046v3 Announce Type: replace Abstract: AdamW has long been the dominant optimizer in language model pretraining, despite numerous claims that alternative optimizers offer 1.4 to 2x speedup. We posit that two methodological shortcomings have obscured fair comparisons and hindered practic

Read on arxiv →
arxiv1h ago

KV Packet: Recomputation-Free Context-Independent KV Caching for LLMs

arXiv:2604.13226v3 Announce Type: replace Abstract: Large Language Models (LLMs) rely heavily on Key-Value (KV) caching to minimize inference latency. However, standard KV caches are context-dependent: reusing a cached document in a new context requires recomputing KV states to account for shifts in

Read on arxiv →
arxiv1h ago

Build, Don't Play: Self-Improving LLM Research Agents Develop a Hearthstone Battlegrounds AI That Rivals Top Players

arXiv:2610.33845v1 Announce Type: cross Abstract: Can LLM agents carry a hard real-world problem from raw data to a system that holds its own against people? We study this in Hearthstone Battlegrounds, an eight-player auto-battler with stochastic shops and battles, hidden information and nearly a th

Read on arxiv →
arxiv1h ago

SearchHorizonBench: A Benchmark for Search Value in AI Agents

arXiv:2610.34714v1 Announce Type: cross Abstract: AI agents must decide when another search is worth its cost. Answer-success probabilities capture question difficulty, while this decision requires estimating the additional benefit of search. We introduce SearchHorizonBench, a benchmark for learning

Read on arxiv →
arxiv1h ago

Efficient Proof Generation for Lean Statements with Multiple Candidate Answers

arXiv:2610.34490v1 Announce Type: cross Abstract: In formal systems such as Lean 4, efficiently finding answers to mathematical problems and generating verifiable proofs is an important task in automated mathematical reasoning. In the traditional way where an upstream solver provides multiple candid

Read on arxiv →
arxiv1h ago

Learning What to Share: Expert Specialization for Time-Series Forecasting

arXiv:2610.33822v1 Announce Type: new Abstract: A central challenge in multivariate forecasting is deciding what to share across channels and where to specialize. Mixture-of-experts models offer flexible sharing, yet it remains unclear how much of their forecasting gains comes from added capacity or

Read on arxiv →
arxiv1h ago

When Agents Collude: Weak-to-Strong On-Policy Distillation for Mitigating Strategic Deception in Multi-Agent Systems

arXiv:2610.33011v1 Announce Type: cross Abstract: While recent advances in autonomous agents enable them to coordinate on increasingly complex tasks, prior work shows that this growing capacity for coordination can create safety risks, including collusion, in which agents jointly pursue misaligned a

Read on arxiv →
arxiv1h ago

Evolving to Match Capabilities: Improving Harness Self-Evolution via Skill Adaptation

arXiv:2610.33024v1 Announce Type: new Abstract: Harness self-evolution offers a practical route for LLM agents to improve from execution experience without updating model parameters. Its effectiveness depends on whether models can successfully act on the guidance provided by their harnesses. However

Read on arxiv →
arxiv1h ago

Lessons from Luck: Do LLM-Written Lessons Carry Chance into an Agent's Next Decision?

arXiv:2610.33029v1 Announce Type: new Abstract: Self-improving agents write lessons from the outcomes of their runs; when outcomes are noisy, a lesson can carry chance into later decisions. We measure one link of this chain in a registered study. In 256 synthetic worlds, each a recurring task with t

Read on arxiv →
arxiv1h ago

EEGBiFormer: Real-Time EEG Attention Classification via Hybrid CNN-Transformer with EEG-Informed Auditory Protocol Validation

arXiv:2610.33832v1 Announce Type: new Abstract: Sustained attention is critical for academic performance, yet existing auditory support tools are static and not grounded in real-time neural evidence. This paper presents EEGBiFormer, a hybrid CNN-Transformer model for realtime binary classification o

Read on arxiv →
arxiv1h ago

SRA: Selective Residual Adaptation for LLM Reasoning Enhancement

arXiv:2610.34199v1 Announce Type: new Abstract: Knowledge distillation transfers reasoning capabilities from large language models to lightweight students. However, distilled small models still struggle with multi-step reasoning. We observe that the distribution divergences between teacher and stude

Read on arxiv →
arxiv1h ago

CORMA: Constraint-Routed Decision Mamba for Generalizable Multi-Constraint Offline Safe Reinforcement Learning

arXiv:2610.34208v1 Announce Type: new Abstract: Offline safe reinforcement learning (RL) learns safety-aware policies from static datasets while satisfying safety constraints during deployment. Motivated by the strong trajectorymodeling capabilities of Transformers, recent Decision Transformer (DT)-

Read on arxiv →
arxiv1h ago

Learning When to Commit: Schedule Distillation for Fast Diffusion Language Models

arXiv:2610.35804v1 Announce Type: cross Abstract: Diffusion large language models (dLLMs) can generate multiple tokens in parallel, but often require many decoding rounds to complete a response. Efficient generation depends not only on which tokens are easy to predict, but also on how committing to

Read on arxiv →
arxiv1h ago

Why Geometric Continuity Emerges in Deep Neural Networks: Residual Connections and Rotational Symmetry Breaking

arXiv:2605.04971v2 Announce Type: replace Abstract: Weight matrices in deep networks exhibit geometric continuity---principal singular vectors of adjacent layers point in similar directions. While this property has been widely observed, its origin remains unexplained. Through experiments on toy MLPs

Read on arxiv →
arxiv1h ago

Hierarchical GNNs for power flow: letting physics shape the hierarchy

arXiv:2609.26603v3 Announce Type: replace Abstract: Hierarchical latent communication improves the generalization of a power-flow model, shared across three grids, to new operating scenarios. The module exchanges information through two reduced graphs inside the corrective network of GENCO, replacin

Read on arxiv →
arxiv1h ago

VLN on the Fly: An Onboard Vision-Language Navigation Stack for Aerial Robots

arXiv:2609.20191v2 Announce Type: replace-cross Abstract: Running vision-language navigation fully onboard an aerial robot is hard, since grounding, planning, and control must share limited compute and a single-stage error is difficult to isolate in flight. End-to-end aerial policies fuse these stag

Read on arxiv →
arxiv1h ago

Graph-dependent pooling: adaptive granularity in hierarchical graph neural networks

arXiv:2610.33623v1 Announce Type: cross Abstract: Graph Neural Networks are widely used to learn structural representations of relational data. Hierarchical graph pooling learns multi-level representations by progressively coarsening graphs; however, prior methods rely on predefined cluster numbers

Read on arxiv →
arxiv1h ago

Budgeted Prompt-Set Expansion and Refinement for Language Models via Simulation Optimization

arXiv:2404.08164v3 Announce Type: replace-cross Abstract: A prompt is an instruction or description provided by the user to guide a generative language model toward outputs that meet application requirements. When these requirements change, existing prompts may need to be adapted and improved. Evalu

Read on arxiv →
arxiv1h ago

Towards Real-world Human Behavior Simulation: Benchmarking Large Language Models on Long-horizon, Cross-scenario, Heterogeneous Behavior Traces

arXiv:2604.08362v3 Announce Type: replace-cross Abstract: The emergence of Large Language Models (LLMs) has illuminated the potential for a general-purpose user simulator. However, existing benchmarks remain constrained to isolated scenarios, narrow action spaces, or synthetic data, failing to captu

Read on arxiv →
arxiv1h ago

Amplitude-Only FFN Intervention for Tool-Structured LLM Inference: Method, Gated Evaluation Protocol, and Cross-Model Empirical Results

arXiv:2607.11183v5 Announce Type: replace-cross Abstract: We study amplitude-only rescaling of feed-forward network (FFN) activations to repair tool calls and other structured outputs, using multiplicative coordinate masks rather than additive steering vectors. Amplitude Gating (AG) keeps pretrained

Read on arxiv →
arxiv1h ago

A Sign Law for Entropy Drift under Sampler Mismatch in RLVR

arXiv:2610.34044v1 Announce Type: new Abstract: Entropy in reinforcement learning with verifiable rewards (RLVR) moves up or down depending on choices that should be neutral, such as whether over-length responses are masked or counted as failures. We trace this to sampler mismatch, where rollouts ar

Read on arxiv →
arxiv1h ago

HumanoidNDM: Closing the Training-Deployment Gap of Motion Tracking via Humanoid Neural Dynamics Model

arXiv:2610.34126v1 Announce Type: cross Abstract: Humanoid robots have recently achieved remarkable success in motion tracking. However, during real-world deployment, robots inevitably encounter dynamics gaps arising from either extra physical disturbances or inaccurate simulation modeling, resultin

Read on arxiv →
arxiv1h ago

Adaptive Transfer of Representational Signatures for LLM Reliability Detection

arXiv:2610.33442v1 Announce Type: cross Abstract: Large language models (LLMs) are reported to be susceptible to reliability issues including hallucinations and reasoning errors. Existing quality detectors can predict unreliable outputs based on internal representations with decent accuracies. Howev

Read on arxiv →
arxiv1h ago

CAFE: Causally-Guided Automated Feature Engineering with Multi-Agent Reinforcement Learning

arXiv:2602.16435v2 Announce Type: replace-cross Abstract: Automated feature engineering (AFE) enables AI systems to autonomously construct high-utility representations from raw tabular data. However, existing AFE methods rely on statistical heuristics, yielding brittle features that fail under distr

Read on arxiv →
arxiv1h ago

LC-GRPO: Bridging Train-Inference Gap for Flow-Based GRPO with Langevin Correction

arXiv:2608.05600v2 Announce Type: replace Abstract: Flow-based generative models are typically sampled by solving a deterministic ordinary differential equation (ODE), whereas reinforcement learning (RL) requires stochastic rollouts for exploration and optimization. Existing online RL methods for fl

Read on arxiv →
arxiv1h ago

CoinRAG: Contextualized Information Nugget KV Cache Reuse for Long-Context RAG

arXiv:2608.07458v2 Announce Type: replace-cross Abstract: Recent optimization studies on Retrieval-Augmented Generation (RAG) have exploited chunk-level KV cache reuse to avoid processing long retrieved contexts for higher efficiency, while significant information redundancy and noise still remain i

Read on arxiv →
arxiv1h ago

Wave Is All You Need: A Quantum Language Model Based on Fully Connected Quantum Boltzmann Machine

arXiv:2610.34492v1 Announce Type: cross Abstract: This work proposes a self-attention mechanism based on the fully connected quantum Boltzmann machine (FC-QBM), and further constructs a fully connected quantum Boltzmann machine language model (FC-QBM-LM) using the mechanism as the core engine. By pe

Read on arxiv →
arxiv1h ago

SATFormer: Learning When to Use Early Value Residuals in Transformers

arXiv:2605.03953v3 Announce Type: replace Abstract: Recent Transformer architectures expose later layers to representations computed in earlier layers, motivated by the observation that low-level features can become harder to recover as the residual stream is transformed through depth. One such meth

Read on arxiv →
arxiv1h ago

Dynamic Short Convolutions Improve Transformers

arXiv:2606.03825v2 Announce Type: replace Abstract: Transformers have become the dominant architecture for large language models, largely due to the scalability and flexibility of attention, feed-forward layers, residual connections, and normalization. This paper introduces dynamic short convolution

Read on arxiv →
arxiv1h ago

A Corpus of Real Scam- and Spam-Call Conversations from an Active Voice-Agent Honeypot

arXiv:2609.29528v2 Announce Type: replace-cross Abstract: Real conversations between fraudsters and their targets are among the most informative artifacts for studying telephone scams, yet also the scarcest: passive honeypots overwhelmingly capture automated messages and hang-ups, large-scale studie

Read on arxiv →
arxiv1h ago

VX-One: Typed, Calibrated Decision Heads for Real-Time Perimeter Triage

arXiv:2610.30090v2 Announce Type: replace-cross Abstract: Perimeter triage faces a latency/semantics trade-off: signature engines are fast and format-safe but blind to unseen attacks, while generative models are semantic but slow and unparseable. We present VX-One, a small multi-head network (100K--

Read on arxiv →
arxiv1h ago

LongSpark: Efficient speculative decoding with a fixed-cost parallel drafter

arXiv:2609.37029v2 Announce Type: replace Abstract: Speculative decoding accelerates autoregressive inference by verifying multiple draft tokens in a single target forward pass. However, as the context grows, existing state-of-the-art drafters become increasingly expensive, eroding the very efficien

Read on arxiv →
PrivacyTermsRefundsLegal notice|AboutMethodologyContact

© 2026 Databubble

Built by Marouane Gazouzi · Readyo, AI interview coach

HomeModelsNews