Combining attention with spectrum to handle missing values on time series data without imputation

In the development of predictive models, the problem of missing data is a critical issue that traditionally requires a two-step analysis. Data scientists analyze the patterns of missing val-ues, select variables, impute missing values on the basis of domain knowledge, and then train a model. Models typically have their input sizes hardcoded, and have limitations in handling data with high missing rates or changes in available variables. We propose an attention -based neural network combined with a novel real number representation, which requires lit-tle work on manually selecting variables, and in which missing data can be overlooked, mak-ing imputation unnecessary. In this proposed model, data analysis can be one step, omitting the first step of imputing missing values. The study included data on 32,709 intensive care unit (ICU) admissions and 60 healthcare variables from the Medical Information Mart for Intensive Care (MIMIC)-IV. The proposed algorithm yielded an area under the receiver oper-ating characteristic curve (AUC) of 0.842 (95% CIs: 0.828-0.856) when predicting prolonged length of stay in the ICU, outperforming current approaches using imputation methods. The proposed algorithm can be applied to a range of problems in data science, as it addresses the issue of incomplete data with automatic variable selection. (c) 2022 The Author(s). Published by Elsevier Inc. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).

Automated summary

In the development of predictive models, handling missing data is a critical issue. Traditional approaches require a two-step analysis to analyze missing patterns, select variables, impute missing values, and train models. However, these models have limitations in handling high missing rates and variable changes. To address this problem, the researchers propose an attention-based neural network combined with a novel real number representation. This algorithm requires less manual variable selection and can overlook missing data, eliminating the need for imputation. The results show that the proposed algorithm outperforms current approaches in predicting prolonged length of stay in the ICU.