·
DataBubble
  • Home
  • Models
  • News
  • Compare
  • Boards
  • Pricing
  • About
  • Newsletter
  • Methodology
  • Contact
Latest
Bringing Value Models Back: Generative Critics for Value Modeling in LLM Reinforcement Learning9h◆Subagents vs Agent Skills: Executing Reusable Knowledge for Long-Horizon Agentic Tasks9h◆Distribution-Consistent Inference for Dynamic Sparse Mixture-of-Experts9h◆In RAG We Trust? Measuring Robustness of Retrieval-Augmented Generation Under Document Poisoning9h◆FrontierChallenge: Evaluating Scientific Workflow Completion9h◆IBIB: A Protocol for Measuring Enterprise AI Systems by Serving Route, Not Model Identifier9h◆AgenticGen: Reward-Guided Agentic Video Generation for Advertising9h◆Strangers to Themselves: What Language Models Say About Themselves Is Generic9h◆Omni Interaction Agent Technical Report9h◆CoGReV: A Confidence-Gated Post-Hoc Non-Monotonic Belief Revision Framework for Phishing Website Classification9h◆Bit-Flip Attacks on Vision-Language-Action Models: Action-Decoding Architecture Shapes the Vulnerability9h◆Can Foundation Models Moderate Online Content? Evaluating Instruction- vs. Example-Driven Policy Operationalization9h◆RiLM: Parameter-Efficient Language Modeling via Geodesic Decoding9h◆Tracing Computation Density in LLMs9h◆Cultural Binding Heads in Language Models9h◆Direct Diversity Optimization for Diverse Successful Trajectories in Preference Post-Training9h◆Left-Branching Transformers Excel at Right-Branching Languages: Data Shapes Word Order Preferences in Language Models9h◆Palmyra x6 Technical Report: An Agentic, Tool-Use Model Post-Trained via Anchored Supervised Fine-Tuning9h◆'Ghaib in Translation' aka Unseen Harm: Measuring Cross-Script Safety Inconsistency with 'Missed-in-Urdu' Scores in LLM Hate Speech Detection9h◆DexterSQL: Deep Schema Exploration and Rule-based Correction for Text-to-SQL Generation9h◆Bringing Value Models Back: Generative Critics for Value Modeling in LLM Reinforcement Learning9h◆Subagents vs Agent Skills: Executing Reusable Knowledge for Long-Horizon Agentic Tasks9h◆Distribution-Consistent Inference for Dynamic Sparse Mixture-of-Experts9h◆In RAG We Trust? Measuring Robustness of Retrieval-Augmented Generation Under Document Poisoning9h◆FrontierChallenge: Evaluating Scientific Workflow Completion9h◆IBIB: A Protocol for Measuring Enterprise AI Systems by Serving Route, Not Model Identifier9h◆AgenticGen: Reward-Guided Agentic Video Generation for Advertising9h◆Strangers to Themselves: What Language Models Say About Themselves Is Generic9h◆Omni Interaction Agent Technical Report9h◆CoGReV: A Confidence-Gated Post-Hoc Non-Monotonic Belief Revision Framework for Phishing Website Classification9h◆Bit-Flip Attacks on Vision-Language-Action Models: Action-Decoding Architecture Shapes the Vulnerability9h◆Can Foundation Models Moderate Online Content? Evaluating Instruction- vs. Example-Driven Policy Operationalization9h◆RiLM: Parameter-Efficient Language Modeling via Geodesic Decoding9h◆Tracing Computation Density in LLMs9h◆Cultural Binding Heads in Language Models9h◆Direct Diversity Optimization for Diverse Successful Trajectories in Preference Post-Training9h◆Left-Branching Transformers Excel at Right-Branching Languages: Data Shapes Word Order Preferences in Language Models9h◆Palmyra x6 Technical Report: An Agentic, Tool-Use Model Post-Trained via Anchored Supervised Fine-Tuning9h◆'Ghaib in Translation' aka Unseen Harm: Measuring Cross-Script Safety Inconsistency with 'Missed-in-Urdu' Scores in LLM Hate Speech Detection9h◆DexterSQL: Deep Schema Exploration and Rule-based Correction for Text-to-SQL Generation9h◆
Tag

#attention mechanisms

4 articles tagged #attention mechanisms

arxivJul 3bullish

A Hippocampus for Linear Attention: An Exact Memory for What the Recurrent State Forgets

arXiv:2607.02303v1 Announce Type: new Abstract: Linear-attention and state-space language models compress the prefix into a fixed-size recurrent state, yielding O(1) memory at the cost of a lossy exact memory: when many key--value associations compete, earlier facts are overwritten and needle recall

HOTRGD3 models#language models#attention mechanisms#memory efficiencyRead on arxiv →
arxivJun 15bullish

Exact Linear Attention

arXiv:2605.18848v4 Announce Type: replace-cross Abstract: This paper introduces Exact Linear Attention (ELA), a mechanism that achieves linear computational complexity for Transformer attention by exploiting the exact decomposition property of kernel functions, thereby eliminating approximation erro

TRYO2 models#machine learning#transformer#attention mechanismsRead on arxiv →
arxivMay 5bullish

FG$^2$-GDN: Enhancing Long-Context Gated Delta Networks with Doubly Fine-Grained Control

arXiv:2604.19021v2 Announce Type: replace Abstract: Linear attention mechanisms have emerged as promising alternatives to softmax attention, offering linear-time complexity during inference. Recent advances such as Gated DeltaNet (GDN) and Kimi Delta Attention (KDA) have demonstrated that the delta

GAKIFG4 models · +1#machine learning#attention mechanisms#optimizationRead on arxiv →
arxivApr 16bullish

FAST: A Synergistic Framework of Attention and State-space Models for Spatiotemporal Traffic Prediction

arXiv:2604.13453v1 Announce Type: new Abstract: Traffic forecasting requires modeling complex temporal dynamics and long-range spatial dependencies over large sensor networks. Existing methods typically face a trade-off between expressiveness and efficiency: Transformer-based models capture global d

TRFAMA4 models · +1#traffic forecasting#spatiotemporal modeling#state-space modelsRead on arxiv →
HomeModelsNews