·
DataBubble
  • Home
  • Models
  • News
  • Compare
  • Boards
  • Pricing
  • About
  • Newsletter
  • Methodology
  • Contact
Latest
SoftBank says it will invest up to €75 billion to build French data centers2h◆‘What a joke’: Github Copilot’s new token-based billing spurs consternation among devs7h◆Meta is reportedly developing an AI pendant7h◆I put Google’s 24/7 AI assistant Gemini Spark to work, and it’s actually pretty useful8h◆How one founder’s bet on ‘the old school web’ is paying off10h◆AI grifters are creating fake Black people to sell Shein junk10h◆As the browser wars heat up, here are the hottest alternatives to Chrome and Safari in 202610h◆The SpaceX IPO is great for Elon Musk and terrible for you11h◆Coders are refusing to work without AI — and that could come back to bite them1d◆Take our I/O 2026 quiz, vibe coded in Google AI Studio.1d◆So you’ve heard these AI terms and nodded along; let’s fix that1d◆What happens when companies become too AI-pilled?1d◆Tech companies desperately want to film you doing chores1d◆9 demos of Gemini Omni and Gemini 3.5 in action1d◆After Nvidia’s $20B not-acqui-hire, AI chip startup Groq reportedly raising $650M1d◆Cognition’s Scott Wu says AI coding agents shouldn’t replace humans1d◆Today is the last day to apply to speak at TechCrunch Disrupt 20261d◆Final 24 hours to save up to $410 on your TechCrunch Disrupt 2026 ticket1d◆Does your CEO have AI psychosis? Aaron Levie thinks most of them do.1d◆Kiwibit’s AI-powered bird feeder is my new backyard buddy1d◆SoftBank says it will invest up to €75 billion to build French data centers2h◆‘What a joke’: Github Copilot’s new token-based billing spurs consternation among devs7h◆Meta is reportedly developing an AI pendant7h◆I put Google’s 24/7 AI assistant Gemini Spark to work, and it’s actually pretty useful8h◆How one founder’s bet on ‘the old school web’ is paying off10h◆AI grifters are creating fake Black people to sell Shein junk10h◆As the browser wars heat up, here are the hottest alternatives to Chrome and Safari in 202610h◆The SpaceX IPO is great for Elon Musk and terrible for you11h◆Coders are refusing to work without AI — and that could come back to bite them1d◆Take our I/O 2026 quiz, vibe coded in Google AI Studio.1d◆So you’ve heard these AI terms and nodded along; let’s fix that1d◆What happens when companies become too AI-pilled?1d◆Tech companies desperately want to film you doing chores1d◆9 demos of Gemini Omni and Gemini 3.5 in action1d◆After Nvidia’s $20B not-acqui-hire, AI chip startup Groq reportedly raising $650M1d◆Cognition’s Scott Wu says AI coding agents shouldn’t replace humans1d◆Today is the last day to apply to speak at TechCrunch Disrupt 20261d◆Final 24 hours to save up to $410 on your TechCrunch Disrupt 2026 ticket1d◆Does your CEO have AI psychosis? Aaron Levie thinks most of them do.1d◆Kiwibit’s AI-powered bird feeder is my new backyard buddy1d◆
News/The Cognitive Categorical Transformer: Category-Theoretic Inductive Biases for Language Modeling
arxiv
PublishedMay 29, 2026 at 4:00 AM
▲bullish

The Cognitive Categorical Transformer: Category-Theoretic Inductive Biases for Language Modeling

Source
arxiv.orgfull article ↗
Read on arxiv→
Publisher summary· verbatim

arXiv:2605.28864v1 Announce Type: new Abstract: The Cognitive Categorical Transformer (CCT) is a 306M-parameter architecture that augments a pretrained GPT-2 Small backbone with cognitively grounded components derived from category theory and several inspirations from cognitive science. Under a matc

Models mentioned
02
  • 01gpt2 logo
    small
    gpt2/small
  • 02gpt2 logo
    large
    gpt2/large
Compare these 2 models→
Stay posted· Newsletter

A 5-min weekly brief — top movers, price watch, story of the week.

// no spam · unsubscribe one-click · free forever

Discussion
Mentioned models
03
  • 01
    Cognitive Categorical Transformer (CCT)
  • 02
    small
    gpt2/small
  • 03
    large
    gpt2/large
Source
↗
arxiv
Read original ↗All from arxiv →
Tags
04
#language-models#transformers#cognitive-science#category-theory

No replies yet. Be first.

Mentioned models
03
  • 01
    Cognitive Categorical Transformer (CCT)
  • 02
    small
    gpt2/small
  • 03
    large
    gpt2/large
Source
↗
arxiv
Read original ↗All from arxiv →
Tags
04
#language-models#transformers#cognitive-science#category-theory
The Bubble Brief
WEEKLY

Read language-models insights every Tuesday — top movers, new releases, story of the week.

// no spam · unsubscribe one-click · free forever

Originally published on arxiv ↗
HomeModelsNews