·
DataBubble
  • Home
  • Models
  • News
  • Compare
  • Boards
  • Pricing
  • About
  • Newsletter
  • Methodology
  • Contact
Latest
Bringing Value Models Back: Generative Critics for Value Modeling in LLM Reinforcement Learning8h◆Subagents vs Agent Skills: Executing Reusable Knowledge for Long-Horizon Agentic Tasks8h◆Distribution-Consistent Inference for Dynamic Sparse Mixture-of-Experts8h◆In RAG We Trust? Measuring Robustness of Retrieval-Augmented Generation Under Document Poisoning8h◆FrontierChallenge: Evaluating Scientific Workflow Completion8h◆IBIB: A Protocol for Measuring Enterprise AI Systems by Serving Route, Not Model Identifier8h◆AgenticGen: Reward-Guided Agentic Video Generation for Advertising8h◆Strangers to Themselves: What Language Models Say About Themselves Is Generic8h◆Omni Interaction Agent Technical Report8h◆CoGReV: A Confidence-Gated Post-Hoc Non-Monotonic Belief Revision Framework for Phishing Website Classification8h◆Bit-Flip Attacks on Vision-Language-Action Models: Action-Decoding Architecture Shapes the Vulnerability8h◆Can Foundation Models Moderate Online Content? Evaluating Instruction- vs. Example-Driven Policy Operationalization8h◆RiLM: Parameter-Efficient Language Modeling via Geodesic Decoding8h◆Tracing Computation Density in LLMs8h◆Cultural Binding Heads in Language Models8h◆Direct Diversity Optimization for Diverse Successful Trajectories in Preference Post-Training8h◆Left-Branching Transformers Excel at Right-Branching Languages: Data Shapes Word Order Preferences in Language Models8h◆Palmyra x6 Technical Report: An Agentic, Tool-Use Model Post-Trained via Anchored Supervised Fine-Tuning8h◆'Ghaib in Translation' aka Unseen Harm: Measuring Cross-Script Safety Inconsistency with 'Missed-in-Urdu' Scores in LLM Hate Speech Detection8h◆DexterSQL: Deep Schema Exploration and Rule-based Correction for Text-to-SQL Generation8h◆Bringing Value Models Back: Generative Critics for Value Modeling in LLM Reinforcement Learning8h◆Subagents vs Agent Skills: Executing Reusable Knowledge for Long-Horizon Agentic Tasks8h◆Distribution-Consistent Inference for Dynamic Sparse Mixture-of-Experts8h◆In RAG We Trust? Measuring Robustness of Retrieval-Augmented Generation Under Document Poisoning8h◆FrontierChallenge: Evaluating Scientific Workflow Completion8h◆IBIB: A Protocol for Measuring Enterprise AI Systems by Serving Route, Not Model Identifier8h◆AgenticGen: Reward-Guided Agentic Video Generation for Advertising8h◆Strangers to Themselves: What Language Models Say About Themselves Is Generic8h◆Omni Interaction Agent Technical Report8h◆CoGReV: A Confidence-Gated Post-Hoc Non-Monotonic Belief Revision Framework for Phishing Website Classification8h◆Bit-Flip Attacks on Vision-Language-Action Models: Action-Decoding Architecture Shapes the Vulnerability8h◆Can Foundation Models Moderate Online Content? Evaluating Instruction- vs. Example-Driven Policy Operationalization8h◆RiLM: Parameter-Efficient Language Modeling via Geodesic Decoding8h◆Tracing Computation Density in LLMs8h◆Cultural Binding Heads in Language Models8h◆Direct Diversity Optimization for Diverse Successful Trajectories in Preference Post-Training8h◆Left-Branching Transformers Excel at Right-Branching Languages: Data Shapes Word Order Preferences in Language Models8h◆Palmyra x6 Technical Report: An Agentic, Tool-Use Model Post-Trained via Anchored Supervised Fine-Tuning8h◆'Ghaib in Translation' aka Unseen Harm: Measuring Cross-Script Safety Inconsistency with 'Missed-in-Urdu' Scores in LLM Hate Speech Detection8h◆DexterSQL: Deep Schema Exploration and Rule-based Correction for Text-to-SQL Generation8h◆
Tag

#inference

12 articles tagged #inference

arxivJul 24

DecodeShare: Tracing the Shared Subspace of LLM Decode-Time Decisions

arXiv:2607.20469v1 Announce Type: new Abstract: Large language models (LLMs) handle many tasks with one set of parameters, but under KV-cached inference it is unclear what task-general structure, if any, is used at decode time rather than during prefill. We propose DecodeShare, a protocol that ident

#large-language-models#inference#decode-timeRead on arxiv →
arxivJul 22bullish

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads

arXiv:2607.18253v1 Announce Type: new Abstract: Modern language query routers improve inference efficiency by assigning each query to a model that balances response quality and monetary cost. However, current query routers are largely latency-agnostic and do not consider the generation latency exper

#optimization#latency#inferenceRead on arxiv →
arxivJul 20

How Much Human Label Variation Does Formal Semantic Structure Explain?: Group-Level Effects and Item-Level Ceilings in NLI

arXiv:2607.15870v1 Announce Type: new Abstract: Human label variation in natural language inference is increasingly treated as signal rather than noise, but how much of it formal semantic structure explains has not been measured directly. We measure it on the 3,113 SNLI and MNLI items of ChaosNLI, u

CHSNMN3 models#natural-language-processing#semantics#inferenceRead on arxiv →
arxivJul 16bullish

NSNQuant: A Double Normalization Approach for Calibration-Free Low-Bit Vector Quantization of KV Cache

arXiv:2505.18231v3 Announce Type: replace-cross Abstract: Large Language Model (LLM) inference is typically memory-intensive, especially when processing large batch sizes and long sequences, due to the large size of key-value (KV) cache. Vector Quantization (VQ) is recently adopted to alleviate this

#machine-learning#vector-quantization#optimizationRead on arxiv →
arxivJun 10bullish

K-Forcing: Joint Next-K-Token Decoding via Push-Forward Language Modeling

arXiv:2606.10820v1 Announce Type: cross Abstract: Autoregressive (AR) language modeling is the dominant paradigm for text generation, yet its sequential token-by-token decoding makes inference memory-bound and inefficient. Existing acceleration approaches, such as speculative decoding and diffusion

K-TR2 models#language-modeling#acceleration#inferenceRead on arxiv →
arxivJun 5bullish

AURA: Intent-Directed Probing for Implicit-Need Surfacing in Situated LLM Agents

arXiv:2606.05557v1 Announce Type: new Abstract: A situated query like "where is Lin Wei?" often encodes more than its literal content: the user may also want to know whether Lin Wei is free, in a good mood, or worth interrupting now. Standard tool-use agents answer the literal question and stop. AUR

AURE2 models#natural-language-processing#inference#benchmarkRead on arxiv →
arxivJun 2bullish

Efficient Test-time Inference for Generative Planning Models

arXiv:2606.00618v1 Announce Type: new Abstract: Generative models have emerged as a powerful paradigm for AI planning, yet their performance remains constrained by the training data distribution. One approach is to improve generated solutions during inference by scaling test-time compute. A more eff

GEHE2 models#planning#inference#optimizationRead on arxiv →
arxivMay 14bullish

Attention Once Is All You Need: Efficient Streaming Inference with Stateful Transformers

arXiv:2605.13784v1 Announce Type: new Abstract: Conventional transformer inference engines are request-driven, paying an O(n) prefill cost on every query. In streaming workloads, where data arrives continuously and queries probe an ever-growing context, this cost is prohibitive. We introduce a data-

VLSGTE3 models#streaming#inference#optimizationRead on arxiv →
arxivMay 8bullish

MACS: Modality-Aware Capacity Scaling for Efficient Multimodal MoE Inference

arXiv:2605.05225v1 Announce Type: cross Abstract: Mixture-of-Experts Multimodal Large Language Models (MoE MLLMs) suffer from a significant efficiency bottleneck during Expert Parallelism (EP) inference due to the straggler effect. This issue is worsened in the multimodal context, as existing token-

MIMA2 models#multimodal#efficiency#inferenceRead on arxiv →
arxivMay 6

E-MIA: Exam-Style Black-Box Membership Inference Attacks against RAG Systems

arXiv:2605.00955v1 Announce Type: cross Abstract: Retrieval-Augmented Generation (RAG) equips large language models (LLMs) with external evidence by retrieving documents at inference time, but it also turns the retrieval corpusinto a sensitive asset. Under a black-box setting, an adversary given a c

RE1 model#security#language-models#inferenceRead on arxiv →
arxivApr 22bullish

CounterRefine: Answer-Conditioned Counterevidence Retrieval for Inference-Time Knowledge Repair in Factual Question Answering

arXiv:2603.16091v2 Announce Type: replace-cross Abstract: In factual question answering, many errors are not failures of access but failures of commitment: the system retrieves relevant evidence, yet still settles on the wrong answer. We present CounterRefine, a lightweight inference-time repair lay

GPGPBA3 models#question answering#retrieval#inferenceRead on arxiv →
arxivApr 10bullish

FVD: Inference-Time Alignment of Diffusion Models via Fleming-Viot Resampling

arXiv:2604.06779v1 Announce Type: new Abstract: We introduce Fleming-Viot Diffusion (FVD), an inference-time alignment method that resolves the diversity collapse commonly observed in Sequential Monte Carlo (SMC) based diffusion samplers. Existing SMC-based diffusion samplers often rely on multinomi

#diffusion#monte-carlo#inferenceRead on arxiv →
HomeModelsNews