·
DataBubble
  • Home
  • Models
  • News
  • Compare
  • Boards
  • Pricing
  • About
  • Newsletter
  • Methodology
  • Contact
Latest
OpenAI puts Pro subscriptions on hold due to Astra demand57m◆Anthropic details distillation campaigns from Alibaba, Moonshot AI, and DeepSeek1h◆Meta’s AI agent Muse is now the No. 2 app in the US2h◆Schools are catching on to Big Tech’s playbook2h◆Anthropic reveals rogue AI agents hate CAPTCHAs, just like you4h◆India’s Pocket FM doubles revenue run rate to $500M as AI powers 93% of audio content4h◆3 ways to prep for your next big race with Search5h◆How a researcher uses Codex and ChatGPT to search for new antimicrobial molecules5h◆Universal Music is launching an AI music platform with ElevenLabs6h◆Now everyone can put data to work6h◆Meta’s Muse AI works and creeps me out6h◆AI agents are flooding public services with new requests7h◆Maven Robotics wants to steal your robot deployment deal7h◆Why the current tech backlash feels different7h◆Mathematicians want proof OpenAI didn’t use their work10h◆Powering AI is an architecture problem10h◆Expanding AI access and cyber defense for federal, state, local, and tribal governments14h◆Introducing ChatGPT for Financial Services14h◆Planning and Scheduling Business Processes under Control-Flow Uncertainty17h◆SIM: Subspace Interaction-based Method for Token-Level Text Anomaly Detection17h◆OpenAI puts Pro subscriptions on hold due to Astra demand57m◆Anthropic details distillation campaigns from Alibaba, Moonshot AI, and DeepSeek1h◆Meta’s AI agent Muse is now the No. 2 app in the US2h◆Schools are catching on to Big Tech’s playbook2h◆Anthropic reveals rogue AI agents hate CAPTCHAs, just like you4h◆India’s Pocket FM doubles revenue run rate to $500M as AI powers 93% of audio content4h◆3 ways to prep for your next big race with Search5h◆How a researcher uses Codex and ChatGPT to search for new antimicrobial molecules5h◆Universal Music is launching an AI music platform with ElevenLabs6h◆Now everyone can put data to work6h◆Meta’s Muse AI works and creeps me out6h◆AI agents are flooding public services with new requests7h◆Maven Robotics wants to steal your robot deployment deal7h◆Why the current tech backlash feels different7h◆Mathematicians want proof OpenAI didn’t use their work10h◆Powering AI is an architecture problem10h◆Expanding AI access and cyber defense for federal, state, local, and tribal governments14h◆Introducing ChatGPT for Financial Services14h◆Planning and Scheduling Business Processes under Control-Flow Uncertainty17h◆SIM: Subspace Interaction-based Method for Token-Level Text Anomaly Detection17h◆
News/Reproduction Beyond Benchmarks: ConstBERT and ColBERT-v2 Across Backends and Query Distributions
arxiv
PublishedApril 18, 2026 at 4:00 AM
▼bearish

Reproduction Beyond Benchmarks: ConstBERT and ColBERT-v2 Across Backends and Query Distributions

Source
arxiv.orgfull article ↗
Read on arxiv→
Publisher summary· verbatim

arXiv:2604.09982v2 Announce Type: replace-cross Abstract: Reproducibility must validate architectural robustness, not just numerical accuracy. We evaluate ColBERT-v2 and ConstBERT across five dimensions, finding that while ConstBERT reproduces within 0.05% MRR@10 on MS-MARCO, both models show a drop

Stay posted· Newsletter

A 5-min weekly brief — top movers, price watch, story of the week.

// no spam · unsubscribe one-click · free forever

Discussion
Mentioned models
02
  • 01
    ColBERT-v2
  • 02
    ConstBERT
Source
↗
arxiv
Read original ↗All from arxiv →
Tags
04
#information retrieval#reproducibility#evaluation#architectural robustness

No replies yet. Be first.

Mentioned models
02
  • 01
    ColBERT-v2
  • 02
    ConstBERT
Source
↗
arxiv
Read original ↗All from arxiv →
Tags
04
#information retrieval#reproducibility#evaluation#architectural robustness

Related coverage

More from ARXIV
arxivPlanning and Scheduling Business Processes under Control-Flow Uncertainty17harxivSIM: Subspace Interaction-based Method for Token-Level Text Anomaly Detection17h
The Bubble Brief
WEEKLY

Read information retrieval insights every Tuesday — top movers, new releases, story of the week.

// no spam · unsubscribe one-click · free forever

Originally published on arxiv ↗
HomeModelsNews