·
DataBubble
  • Home
  • Models
  • News
  • Compare
  • Boards
  • Pricing
  • About
  • Newsletter
  • Methodology
  • Contact
Latest
Cursor makes its biggest India push yet ahead of SpaceX acquisition with localized pricing4h◆Reverso: Efficient Time Series Foundation Models for Zero-shot Forecasting5h◆Multinex: Lightweight Low-light Image Enhancement via Multi-prior Retinex5h◆Market Design for AI: Beyond the Copyright Binary5h◆Who Pays the Price? Stakeholder-Centric Prompt Injection Benchmarking for Real-world Web Agents5h◆TextRich: A Multi-Domain Benchmark for Detecting AI-Generated Text-Rich Images from GPT-Image-25h◆DiscoLoop: Looping Discrete Embeddings and Continuous Hidden States for Multi-hop Reasoning5h◆From World Models to World Action Models: A Concise Tutorial for Robotics5h◆QuantFlow: A Federated Mamba-Based Post-Transformer Foundation Model for Time-Series Forecasting5h◆Multi-Turn On-Policy Distillation with Prefix Replay5h◆Operational Proto-Introspection in Looped Language Models: Process-Quality Taps, Executable Branching, and the Readout-Control Boundary5h◆Skillware: A Software Ontology and Engineering Lifecycle for Persistent Behavioral Artifacts5h◆MedDDC-Eval: Diagnosis-Decoupled Evaluation of Multi-Turn Medical Consultation Agents5h◆PhantomFill: When the Form Demands an Answer, Language Models Invent One5h◆Error Certificates for KV-Cache Eviction via Randomized Design5h◆Explaining GAND: A Resource on Gender-Ambiguous Natural Data & Contrastive Attribution5h◆MioFFAn: an Annotation Software for Formula Formalization with LLM Automation Capabilities5h◆LA-RL: Label-Aware Self-Reflection for Reinforcement Learning in Information Extraction5h◆Mwando: Leveraging AI to Preserve and Teach shiKomori5h◆The JEPA Paradox in Language: The Geometry of Linguistic Alternatives5h◆Cursor makes its biggest India push yet ahead of SpaceX acquisition with localized pricing4h◆Reverso: Efficient Time Series Foundation Models for Zero-shot Forecasting5h◆Multinex: Lightweight Low-light Image Enhancement via Multi-prior Retinex5h◆Market Design for AI: Beyond the Copyright Binary5h◆Who Pays the Price? Stakeholder-Centric Prompt Injection Benchmarking for Real-world Web Agents5h◆TextRich: A Multi-Domain Benchmark for Detecting AI-Generated Text-Rich Images from GPT-Image-25h◆DiscoLoop: Looping Discrete Embeddings and Continuous Hidden States for Multi-hop Reasoning5h◆From World Models to World Action Models: A Concise Tutorial for Robotics5h◆QuantFlow: A Federated Mamba-Based Post-Transformer Foundation Model for Time-Series Forecasting5h◆Multi-Turn On-Policy Distillation with Prefix Replay5h◆Operational Proto-Introspection in Looped Language Models: Process-Quality Taps, Executable Branching, and the Readout-Control Boundary5h◆Skillware: A Software Ontology and Engineering Lifecycle for Persistent Behavioral Artifacts5h◆MedDDC-Eval: Diagnosis-Decoupled Evaluation of Multi-Turn Medical Consultation Agents5h◆PhantomFill: When the Form Demands an Answer, Language Models Invent One5h◆Error Certificates for KV-Cache Eviction via Randomized Design5h◆Explaining GAND: A Resource on Gender-Ambiguous Natural Data & Contrastive Attribution5h◆MioFFAn: an Annotation Software for Formula Formalization with LLM Automation Capabilities5h◆LA-RL: Label-Aware Self-Reflection for Reinforcement Learning in Information Extraction5h◆Mwando: Leveraging AI to Preserve and Teach shiKomori5h◆The JEPA Paradox in Language: The Geometry of Linguistic Alternatives5h◆
Tag

#transformers

5 articles tagged #transformers

arxivJun 1bullish

Fixed Universal Transformers

arXiv:2605.31423v1 Announce Type: new Abstract: We introduce \emph{universal transformers}: fixed transformers that can simulate any transformer in a given class via a suitable input embedding. Analogous to a universal Turing machine, the input embedding encodes a description of the target model whi

TR1 model#machine-learning#transformers#universalityRead on arxiv →
HomeModelsNews
arxivMay 29bullish

The Cognitive Categorical Transformer: Category-Theoretic Inductive Biases for Language Modeling

arXiv:2605.28864v1 Announce Type: new Abstract: The Cognitive Categorical Transformer (CCT) is a 306M-parameter architecture that augments a pretrained GPT-2 Small backbone with cognitively grounded components derived from category theory and several inspirations from cognitive science. Under a matc

COGPGP3 models#language-models#transformers#cognitive-scienceRead on arxiv →
arxivMay 16bullish

Krause Synchronization Transformers

arXiv:2602.11534v3 Announce Type: replace-cross Abstract: Self-attention in Transformers relies on globally normalized softmax weights, causing all tokens to compete for influence at every layer. When composed across depth, this interaction pattern induces strong synchronization dynamics that favor

MEQWVI3 models#transformers#attention#efficiencyRead on arxiv →
arxivApr 30bullish

Exploring the Potential of Probabilistic Transformer for Time Series Modeling: A Report on the ST-PT Framework

arXiv:2604.26762v1 Announce Type: cross Abstract: The Probabilistic Transformer (PT) establishes that the Transformer's self-attention plus its feed-forward block is mathematically equivalent to Mean-Field Variational Inference (MFVI) on a Conditional Random Field (CRF). Under this equivalence the T

PRSP2 models#time-series#probabilistic-models#transformersRead on arxiv →
arxivApr 21bullish

Sequential KV Cache Compression via Probabilistic Language Tries: Beyond the Per-Vector Shannon Limit

arXiv:2604.15356v1 Announce Type: cross Abstract: Recent work on KV cache quantization, culminating in TurboQuant, has approached the Shannon entropy limit for per-vector compression of transformer key-value caches. We observe that this limit applies to a strictly weaker problem than the one that ac

TU1 model#compression#quantization#transformersRead on arxiv →