Paragraph Segmentation Revisited: Towards a Standard Task for Structuring Speech

View PDF HTML (experimental) Abstract:Automatic speech transcripts are often delivered as unstructured word streams that impede readability and repurposing. We recast paragraph segmentation as the missing structuring step and fill three gaps at the intersection of speech processing and text segmentation. First, we establish TEDPara (human-annotated TED talks) and YTSegPara (YouTube videos with synthetic labels) as the first benchmarks for the paragraph segmentation task. The benchmarks focus on the underexplored speech domain, where paragraph segmentation has traditionally not been part of post-processing, while also contributing to the wider text segmentation field, which still lacks robust and naturalistic benchmarks. Second, we propose a constrained-decoding formulation that lets large language models insert paragraph breaks while preserving the original transcript, enabling faithful, sentence-aligned evaluation. Third, we show that a compact model (MiniSeg) attains state-of-the-art accuracy and, when extended hierarchically, jointly predicts chapters and paragraphs with minimal computational cost. Together, our resources and methods establish paragraph segmentation as a standardized, practical task in speech processing. Comments: Accepted at LREC 2026 Subjects: Computation and Language (cs.CL) Cite as: arXiv:2512.24517 [cs.CL] (or arXiv:2512.24517v2 [cs.CL] for this version) https://doi.org/10.48550/arXiv.2512.24517 arXiv-issued DOI via DataCite Submission history From: Fabian Retkowski [view email] [v1] Tue, 30 Dec 2025 23:29:51 UTC (937 KB) [v2] Thu, 9 Apr 2026 08:58:52 UTC (942 KB)