·
DataBubble
  • Home
  • Models
  • News
  • Compare
  • Boards
  • Pricing
  • About
  • Newsletter
  • Methodology
  • Contact
Latest
Bringing Value Models Back: Generative Critics for Value Modeling in LLM Reinforcement Learning8h◆Subagents vs Agent Skills: Executing Reusable Knowledge for Long-Horizon Agentic Tasks8h◆Distribution-Consistent Inference for Dynamic Sparse Mixture-of-Experts8h◆In RAG We Trust? Measuring Robustness of Retrieval-Augmented Generation Under Document Poisoning8h◆FrontierChallenge: Evaluating Scientific Workflow Completion8h◆IBIB: A Protocol for Measuring Enterprise AI Systems by Serving Route, Not Model Identifier8h◆AgenticGen: Reward-Guided Agentic Video Generation for Advertising8h◆Strangers to Themselves: What Language Models Say About Themselves Is Generic8h◆Omni Interaction Agent Technical Report8h◆CoGReV: A Confidence-Gated Post-Hoc Non-Monotonic Belief Revision Framework for Phishing Website Classification8h◆Bit-Flip Attacks on Vision-Language-Action Models: Action-Decoding Architecture Shapes the Vulnerability8h◆Can Foundation Models Moderate Online Content? Evaluating Instruction- vs. Example-Driven Policy Operationalization8h◆RiLM: Parameter-Efficient Language Modeling via Geodesic Decoding8h◆Tracing Computation Density in LLMs8h◆Cultural Binding Heads in Language Models8h◆Direct Diversity Optimization for Diverse Successful Trajectories in Preference Post-Training8h◆Left-Branching Transformers Excel at Right-Branching Languages: Data Shapes Word Order Preferences in Language Models8h◆Palmyra x6 Technical Report: An Agentic, Tool-Use Model Post-Trained via Anchored Supervised Fine-Tuning8h◆'Ghaib in Translation' aka Unseen Harm: Measuring Cross-Script Safety Inconsistency with 'Missed-in-Urdu' Scores in LLM Hate Speech Detection8h◆DexterSQL: Deep Schema Exploration and Rule-based Correction for Text-to-SQL Generation8h◆Bringing Value Models Back: Generative Critics for Value Modeling in LLM Reinforcement Learning8h◆Subagents vs Agent Skills: Executing Reusable Knowledge for Long-Horizon Agentic Tasks8h◆Distribution-Consistent Inference for Dynamic Sparse Mixture-of-Experts8h◆In RAG We Trust? Measuring Robustness of Retrieval-Augmented Generation Under Document Poisoning8h◆FrontierChallenge: Evaluating Scientific Workflow Completion8h◆IBIB: A Protocol for Measuring Enterprise AI Systems by Serving Route, Not Model Identifier8h◆AgenticGen: Reward-Guided Agentic Video Generation for Advertising8h◆Strangers to Themselves: What Language Models Say About Themselves Is Generic8h◆Omni Interaction Agent Technical Report8h◆CoGReV: A Confidence-Gated Post-Hoc Non-Monotonic Belief Revision Framework for Phishing Website Classification8h◆Bit-Flip Attacks on Vision-Language-Action Models: Action-Decoding Architecture Shapes the Vulnerability8h◆Can Foundation Models Moderate Online Content? Evaluating Instruction- vs. Example-Driven Policy Operationalization8h◆RiLM: Parameter-Efficient Language Modeling via Geodesic Decoding8h◆Tracing Computation Density in LLMs8h◆Cultural Binding Heads in Language Models8h◆Direct Diversity Optimization for Diverse Successful Trajectories in Preference Post-Training8h◆Left-Branching Transformers Excel at Right-Branching Languages: Data Shapes Word Order Preferences in Language Models8h◆Palmyra x6 Technical Report: An Agentic, Tool-Use Model Post-Trained via Anchored Supervised Fine-Tuning8h◆'Ghaib in Translation' aka Unseen Harm: Measuring Cross-Script Safety Inconsistency with 'Missed-in-Urdu' Scores in LLM Hate Speech Detection8h◆DexterSQL: Deep Schema Exploration and Rule-based Correction for Text-to-SQL Generation8h◆
Tag

#long-context

5 articles tagged #long-context

arxivJul 10

Understanding Axes of Difficulty For Long Context Tasks Via PredicateLongBench

arXiv:2607.08284v1 Announce Type: new Abstract: Large language models (LLMs) have demonstrated rapidly improving long-context capabilities, prompting a wave of benchmarks designed to evaluate them. However, existing long-context evaluations - from Needle-in-a-Haystack (NIAH) tests to more recent mul

#benchmark#long-context#evaluationRead on arxiv →
arxivJun 26bullish

HomeModelsNews
EvoEmbedding: Evolvable Representations for Long-Context Retrieval and Agentic Memory

arXiv:2606.21649v2 Announce Type: replace Abstract: Existing embedding models are inherently static: they encode text segments in isolation, ignoring their surrounding context and temporal order. This paper introduces EvoEmbedding, a novel embedding model that generates evolvable representations for

EVQWKA4 models · +1#retrieval#embedding#long-contextRead on arxiv →
arxivJun 17

A Recipe for Long-Context Reasoning in Large Language Models via On-Policy Optimization and Distillation

arXiv:2605.12227v2 Announce Type: replace Abstract: Existing approaches to post-train models for long-context tasks face complementary limitations: (i) supervised fine-tuning (SFT) provides stable supervision but suffers from exposure bias; (ii) reinforcement learning methods such as Group Relative

GRON2 models#long-context#reinforcement learning#distillationRead on arxiv →
arxivApr 17bullish

Shuffle the Context: RoPE-Perturbed Self-Distillation for Long-Context Adaptation

arXiv:2604.14339v1 Announce Type: new Abstract: Large language models (LLMs) increasingly operate in settings that require reliable long-context understanding, such as retrieval-augmented generation and multi-document reasoning. A common strategy is to fine-tune pretrained short-context models at th

MEQW2 models#long-context#language-models#self-distillationRead on arxiv →
arxivApr 13bullish

CSAttention: Centroid-Scoring Attention for Accelerating LLM Inference

arXiv:2604.08584v1 Announce Type: cross Abstract: Long-context LLMs increasingly rely on extended, reusable prefill prompts for agents and domain Q&A, pushing attention and KV-cache to become the dominant decode-time bottlenecks. While sparse attention reduces computation and transfer costs, it ofte

#sparse-attention#long-context#machine-learningRead on arxiv →