期刊
APPLIED SCIENCES-BASEL
卷 12, 期 4, 页码 -出版社
MDPI
DOI: 10.3390/app12041870
关键词
handwritten text recognition; Residual Network; Transformer model; object detection; named entity recognition
类别
资金
- National Research Foundation of Korea (NRF) - Korea government (MSIP) [NRF-2019R1A2C1003306]
The proposed handwritten text recognition pipeline effectively locates and recognizes text, and identifies the context of the text. Clinical receipts were used as the subjects of study.
Featured Application The proposed handwritten text recognition pipeline can be used for practical documents transcription and context recognition. Despite concerted efforts towards handwritten text recognition, the automatic location and transcription of handwritten text remain a challenging task. Text detection and segmentation methods are often prone to errors, affecting the accuracy of the subsequent recognition procedure. In this paper, a pipeline that locates texts on a page and recognizes the text types, as well as the context of the texts within the detected region, is proposed. Clinical receipts are used as the subject of study. The proposed model is comprised of an object detection neural network that extracts text sequences present on the page regardless of size, orientation, and type (handwritten text, printed text, or non-text). After that, the text sequences are fed to a Residual Network with a Transformer (ResNet-101T) model to perform transcription. Next, the transcribed text sequences are analyzed using a Named Entity Recognition (NER) model to classify the text sequences into their corresponding contexts (e.g., name, address, prescription, and bill amount). In the proposed pipeline, all the processes are implicitly learned from data. Experiments performed on 500 self-collected clinical receipts containing 15,297 text segments reported a character error rate (CER) and word error rate (WER) of 7.77% and 10.77%, respectively.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据