Journal
APPLIED SCIENCES-BASEL
Volume 12, Issue 4, Pages -Publisher
MDPI
DOI: 10.3390/app12041870
Keywords
handwritten text recognition; Residual Network; Transformer model; object detection; named entity recognition
Categories
Funding
- National Research Foundation of Korea (NRF) - Korea government (MSIP) [NRF-2019R1A2C1003306]
Ask authors/readers for more resources
The proposed handwritten text recognition pipeline effectively locates and recognizes text, and identifies the context of the text. Clinical receipts were used as the subjects of study.
Featured Application The proposed handwritten text recognition pipeline can be used for practical documents transcription and context recognition. Despite concerted efforts towards handwritten text recognition, the automatic location and transcription of handwritten text remain a challenging task. Text detection and segmentation methods are often prone to errors, affecting the accuracy of the subsequent recognition procedure. In this paper, a pipeline that locates texts on a page and recognizes the text types, as well as the context of the texts within the detected region, is proposed. Clinical receipts are used as the subject of study. The proposed model is comprised of an object detection neural network that extracts text sequences present on the page regardless of size, orientation, and type (handwritten text, printed text, or non-text). After that, the text sequences are fed to a Residual Network with a Transformer (ResNet-101T) model to perform transcription. Next, the transcribed text sequences are analyzed using a Named Entity Recognition (NER) model to classify the text sequences into their corresponding contexts (e.g., name, address, prescription, and bill amount). In the proposed pipeline, all the processes are implicitly learned from data. Experiments performed on 500 self-collected clinical receipts containing 15,297 text segments reported a character error rate (CER) and word error rate (WER) of 7.77% and 10.77%, respectively.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available