·
DataBubble
  • Home
  • Models
  • News
  • Compare
  • Boards
  • Pricing
  • About
  • Newsletter
  • Methodology
  • Contact
Latest
Hikers rescued after using Google Gemini for planning1h◆OpenAI confirms ‘wiki incident,’ says it’s ‘working on a framework’ for more disclosure2h◆OpenAI admits to German wiki ‘incident’9h◆XDOF, just three months out of stealth, is in talks for a Series B at a $1.2B valuation21h◆OpenAI’s rogue agents keep escaping, with no formal process to investigate them21h◆AI compute provider Nscale is looking for $3.5B in pre-IPO financing23h◆Architecting memory and storage in the AI era1d◆Roland is getting into generative AI music with Melody Flip1d◆What will Apple’s John Ternus era look like?1d◆Another swarm of OpenAI agents reached the open internet without the frontier lab’s knowledge1d◆Microsoft says virtually nobody was grabbing NYT articles through its chatbot1d◆Apple’s Ternus era begins as Nvidia bets on the whole AI stack1d◆Google’s Gemini Spark can now manage your Google Photos library1d◆Less than 24 hours to apply for your TechCrunch Disrupt 2026 Side Event1d◆Rogue OpenAI agents appear to have organized another attack using a German wiki1d◆Instagram’s AI detection is a mess (again)1d◆Why AI food looks like that1d◆Microsoft’s Project Zenith is a ‘distraction-free Windows experience’ for developers1d◆Sam Altman apologizes for ‘messy’ GPT-6 Astra rollout that’s locked out paying users1d◆This NAS company wants to run your local smart home1d◆Hikers rescued after using Google Gemini for planning1h◆OpenAI confirms ‘wiki incident,’ says it’s ‘working on a framework’ for more disclosure2h◆OpenAI admits to German wiki ‘incident’9h◆XDOF, just three months out of stealth, is in talks for a Series B at a $1.2B valuation21h◆OpenAI’s rogue agents keep escaping, with no formal process to investigate them21h◆AI compute provider Nscale is looking for $3.5B in pre-IPO financing23h◆Architecting memory and storage in the AI era1d◆Roland is getting into generative AI music with Melody Flip1d◆What will Apple’s John Ternus era look like?1d◆Another swarm of OpenAI agents reached the open internet without the frontier lab’s knowledge1d◆Microsoft says virtually nobody was grabbing NYT articles through its chatbot1d◆Apple’s Ternus era begins as Nvidia bets on the whole AI stack1d◆Google’s Gemini Spark can now manage your Google Photos library1d◆Less than 24 hours to apply for your TechCrunch Disrupt 2026 Side Event1d◆Rogue OpenAI agents appear to have organized another attack using a German wiki1d◆Instagram’s AI detection is a mess (again)1d◆Why AI food looks like that1d◆Microsoft’s Project Zenith is a ‘distraction-free Windows experience’ for developers1d◆Sam Altman apologizes for ‘messy’ GPT-6 Astra rollout that’s locked out paying users1d◆This NAS company wants to run your local smart home1d◆
News/Vowel Signs Are Not Letters: A Pre-tokenization Ceiling on Multilingual Tokenizer Fertility
arxiv
PublishedAugust 28, 2026 at 4:00 AM
—neutral

Vowel Signs Are Not Letters: A Pre-tokenization Ceiling on Multilingual Tokenizer Fertility

Source
arxiv.orgfull article ↗
Read on arxiv→
Publisher summary· verbatim

arXiv:2608.26449v1 Announce Type: new Abstract: Byte-level BPE tokenizers that use the HuggingFace ByteLevel pre-tokenizer inherit GPT-2's word regex, where a word is defined as \p{L}+, one or more Unicode letters. In abugida scripts, vowels are written as combining marks; this pattern therefore spl

Stay posted· Newsletter

A 5-min weekly brief — top movers, price watch, story of the week.

// no spam · unsubscribe one-click · free forever

Discussion
Source
↗
arxiv
Read original ↗All from arxiv →

No replies yet. Be first.

Source
↗
arxiv
Read original ↗All from arxiv →
The Bubble Brief
WEEKLY

Read AI insights every Tuesday — top movers, new releases, story of the week.

// no spam · unsubscribe one-click · free forever

Originally published on arxiv ↗
HomeModelsNews