Journal
BMC MEDICAL INFORMATICS AND DECISION MAKING
Volume 19, Issue -, Pages -Publisher
BMC
DOI: 10.1186/s12911-019-0784-1
Keywords
Lexical variation; Natural language processing; Information retrieval
Categories
Funding
- University of Michigan
Ask authors/readers for more resources
BackgroundNumbers and numerical concepts appear frequently in free text clinical notes from electronic health records. Knowledge of the frequent lexical variations of these numerical concepts, and their accurate identification, is important for many information extraction tasks. This paper describes an analysis of the variation in how numbers and numerical concepts are represented in clinical notes.MethodsWe used an inverted index of approximately 100 million notes to obtain the frequency of various permutations of numbers and numerical concepts, including the use of Roman numerals, numbers spelled as English words, and invalid dates, among others. Overall, twelve types of lexical variants were analyzed.ResultsWe found substantial variation in how these concepts were represented in the notes, including multiple data quality issues. We also demonstrate that not considering these variations could have substantial real-world implications for cohort identification tasks, with one case missing >80% of potential patients.ConclusionsNumbering within clinical notes can be variable, and not taking these variations into account could result in missing or inaccurate information for natural language processing and information retrieval tasks.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available