Automated ICF Coding of Rehabilitation Notes for Low-Resource Languages via Continual Training of Language Models

The coding of medical documents and in particular of rehabilitation notes using the International Classification of Functioning, Disability and Health (ICF) is a difficult task showing low agreement among experts. Such difficulty is mainly caused by the specific terminology that needs to be used for the task. In this paper, we address the task developing a model based on a large language model, BERT. By leveraging continual training of such a model using ICF textual descriptions, we are able to effectively encode rehabilitation notes expressed in Italian, an under-resourced language.

Automated summary

In this paper, the authors tackle the challenging task of coding rehabilitation notes using ICF by developing a model based on the popular language model BERT. They effectively encode Italian rehabilitation notes by leveraging continual training of the model with ICF textual descriptions.