Typical text spotters follow the two-stage spotting paradigm which detects the boundary for a text instance first and then performs text recognition within the detected regions. Despite the remarkable progress of such spotting paradigm, an important limitation is that the performance of text recognition depends heavily on the precision of text detection, resulting in the potential error propagation from detection to recognition. In this work, we propose the single shot Self-Reliant Scene Text Spotter v2 (SRSTS v2), which circumvents this limitation by decoupling recognition from detection while optimizing two tasks collaboratively. Specifically, our SRSTS v2 samples representative feature points around each potential text instance, and conducts both text detection and recognition in parallel guided by these sampled points. Thus, the text recognition is no longer dependent on detection, thereby alleviating the error propagation from detection to recognition. Moreover, the sampling module is learned under the supervision from both detection and recognition, which allows for the collaborative optimization and mutual enhancement between two tasks. Benefiting from such sampling-driven concurrent spotting framework, our approach is able to recognize the text instances correctly even if the precise text boundaries are challenging to detect. Extensive experiments on four benchmarks demonstrate that our method compares favorably to state-of-the-art spotters.
翻译:典型的文字识别器遵循两阶段识别范式,即先检测文本实例的边界,再在检测区域内进行文字识别。尽管该范式取得了显著进展,但其重要局限性在于文字识别的性能高度依赖于文本检测的精度,导致从检测到识别的潜在误差传播。本文提出单发自洽场景文字识别器v2(SRSTS v2),通过解耦识别与检测并协同优化两个任务来规避这一局限。具体而言,我们的SRSTS v2在每个潜在文本实例周围采样代表性特征点,并基于这些采样点并行执行文本检测与识别。因此,文字识别不再依赖检测结果,从而缓解了从检测到识别的误差传播。此外,采样模块在检测和识别的联合监督下进行学习,使两个任务能够协同优化并相互增强。得益于这种采样驱动的并发识别框架,即使文本边界难以精确检测,我们的方法也能正确识别文本实例。在四个基准数据集上的大量实验表明,我们的方法优于现有最先进的识别器。