·
DataBubble
  • Home
  • Models
  • News
  • Compare
  • Boards
  • Pricing
  • About
  • Newsletter
  • Methodology
  • Contact
Latest
SoftBank says it will invest up to €75 billion to build French data centers15h◆‘What a joke’: Github Copilot’s new token-based billing spurs consternation among devs20h◆Meta is reportedly developing an AI pendant21h◆I put Google’s 24/7 AI assistant Gemini Spark to work, and it’s actually pretty useful21h◆How one founder’s bet on ‘the old school web’ is paying off1d◆AI grifters are creating fake Black people to sell Shein junk1d◆As the browser wars heat up, here are the hottest alternatives to Chrome and Safari in 20261d◆The SpaceX IPO is great for Elon Musk and terrible for you1d◆Coders are refusing to work without AI — and that could come back to bite them1d◆Take our I/O 2026 quiz, vibe coded in Google AI Studio.1d◆So you’ve heard these AI terms and nodded along; let’s fix that1d◆What happens when companies become too AI-pilled?1d◆Tech companies desperately want to film you doing chores1d◆9 demos of Gemini Omni and Gemini 3.5 in action1d◆After Nvidia’s $20B not-acqui-hire, AI chip startup Groq reportedly raising $650M1d◆Cognition’s Scott Wu says AI coding agents shouldn’t replace humans1d◆Today is the last day to apply to speak at TechCrunch Disrupt 20261d◆Final 24 hours to save up to $410 on your TechCrunch Disrupt 2026 ticket1d◆Does your CEO have AI psychosis? Aaron Levie thinks most of them do.1d◆Kiwibit’s AI-powered bird feeder is my new backyard buddy2d◆SoftBank says it will invest up to €75 billion to build French data centers15h◆‘What a joke’: Github Copilot’s new token-based billing spurs consternation among devs20h◆Meta is reportedly developing an AI pendant21h◆I put Google’s 24/7 AI assistant Gemini Spark to work, and it’s actually pretty useful21h◆How one founder’s bet on ‘the old school web’ is paying off1d◆AI grifters are creating fake Black people to sell Shein junk1d◆As the browser wars heat up, here are the hottest alternatives to Chrome and Safari in 20261d◆The SpaceX IPO is great for Elon Musk and terrible for you1d◆Coders are refusing to work without AI — and that could come back to bite them1d◆Take our I/O 2026 quiz, vibe coded in Google AI Studio.1d◆So you’ve heard these AI terms and nodded along; let’s fix that1d◆What happens when companies become too AI-pilled?1d◆Tech companies desperately want to film you doing chores1d◆9 demos of Gemini Omni and Gemini 3.5 in action1d◆After Nvidia’s $20B not-acqui-hire, AI chip startup Groq reportedly raising $650M1d◆Cognition’s Scott Wu says AI coding agents shouldn’t replace humans1d◆Today is the last day to apply to speak at TechCrunch Disrupt 20261d◆Final 24 hours to save up to $410 on your TechCrunch Disrupt 2026 ticket1d◆Does your CEO have AI psychosis? Aaron Levie thinks most of them do.1d◆Kiwibit’s AI-powered bird feeder is my new backyard buddy2d◆
News/Features have life history. And we should care
arxiv
PublishedMay 21, 2026 at 4:00 AM
—neutral

Features have life history. And we should care

Source
arxiv.orgfull article ↗
Read on arxiv→
Publisher summary· verbatim

arXiv:2605.18789v1 Announce Type: cross Abstract: Features in language models have life history: they emerge, persist, and die during training, yet the importance of that history remains largely unexplored. We find evidence of a persistent representational backbone, which we identify in Pythia-160M

Stay posted· Newsletter

A 5-min weekly brief — top movers, price watch, story of the week.

// no spam · unsubscribe one-click · free forever

Discussion
Mentioned models
02
  • 01
    Pythia-160M
  • 02
    Pythia-410M
Source
↗
arxiv
Read original ↗All from arxiv →
Tags
04
#language models#training dynamics#neural networks#representational learning

No replies yet. Be first.

Mentioned models
02
  • 01
    Pythia-160M
  • 02
    Pythia-410M
Source
↗
arxiv
Read original ↗All from arxiv →
Tags
04
#language models#training dynamics#neural networks#representational learning
The Bubble Brief
WEEKLY

Read language models insights every Tuesday — top movers, new releases, story of the week.

// no spam · unsubscribe one-click · free forever

Originally published on arxiv ↗
HomeModelsNews