arxiv
PublishedSeptember 7, 2026 at 4:00 AM
—neutral
FVSpec: Real-World Property-Based Tests as Lean Challenges
Publisher summary· verbatim
arXiv:2606.01008v3 Announce Type: replace-cross Abstract: We present a benchmark for evaluating AI models and agents on real-world formal software verification tasks. We first scrape 11,039 property-based tests (PBTs) from real-world Python repositories, then automatically translate 2,772 of them (2
Stay posted· Newsletter
A 5-min weekly brief — top movers, price watch, story of the week.
Discussion
No replies yet. Be first.
Related coverage
More from ARXIV
arxivExtremely Sparse Supervision Incentivizes Reasoning Ability21harxivConstructing and Evaluating Clinical Reasoning Trajectories for Medical Agent21harxivWhen Seeing Overrides Knowing: Visual Dominance and Deferral-Based Method for Personalized Safety in VLMs21harxivBlockchain-Enabled Secure Logging for Fiscal Electronic Mechanisms: Evaluation of the Greek eSEND and myDATA Tax Systems21hThe Bubble Brief
WEEKLYRead AI insights every Tuesday — top movers, new releases, story of the week.
Originally published on arxiv ↗