Hongxiang Cai, Jun Sun, Yichao Xiong
The prevalent perspectives of scene text recognition are from sequence to sequence (seq2seq) and segmentation. Nevertheless, the former is composed of many components which makes implementation and deployment complicated, while the latter requires character level annotations that is expensive. In this paper, we revisit classification perspective that models scene text recognition as an image classification problem. Classification perspective has a simple pipeline and only needs word level annotations. We revive classification perspective by devising a scene text recognition model named as CSTR, which performs as well as methods from other perspectives. The CSTR model consists of CPNet (classification perspective network) and SPPN (separated conv with global average pooling prediction network). CSTR is as simple as image classification model like ResNet \cite{he2016deep} which makes it easy to implement and deploy. We demonstrate the effectiveness of the classification perspective on scene text recognition with extensive experiments. Futhermore, CSTR achieves nearly state-of-the-art performance on six public benchmarks including regular text, irregular text. The code will be available at https://github.com/Media-Smart/vedastr.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Scene Parsing | SVT | Accuracy | 90.6 | CSTR |
| Scene Parsing | ICDAR2015 | Accuracy | 81.6 | CSTR |
| Scene Parsing | ICDAR 2003 | Accuracy | 94.8 | CSTR |
| Scene Parsing | ICDAR2013 | Accuracy | 93.2 | CSTR |
| 2D Semantic Segmentation | SVT | Accuracy | 90.6 | CSTR |
| 2D Semantic Segmentation | ICDAR2015 | Accuracy | 81.6 | CSTR |
| 2D Semantic Segmentation | ICDAR 2003 | Accuracy | 94.8 | CSTR |
| 2D Semantic Segmentation | ICDAR2013 | Accuracy | 93.2 | CSTR |
| Scene Text Recognition | SVT | Accuracy | 90.6 | CSTR |
| Scene Text Recognition | ICDAR2015 | Accuracy | 81.6 | CSTR |
| Scene Text Recognition | ICDAR 2003 | Accuracy | 94.8 | CSTR |
| Scene Text Recognition | ICDAR2013 | Accuracy | 93.2 | CSTR |