Journal
IEEE TRANSACTIONS ON BIG DATA
Volume 6, Issue 2, Pages 359-368Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TBDATA.2016.2623323
Keywords
Diseases; Medical diagnostic imaging; Diabetes; Big data; Indexes; Sociology; Comorbidity conditions; cardiovascular disease; two-way clustering; weighted k-means clustering; model-based clustering; weighted observations
Funding
- Columbia University Data Science Institute
- Rutgers Dean's Fund for Summer Ph.D. Research Assistantships
Ask authors/readers for more resources
Comorbidity greatly increases the complexity of managing disease in patients. Approximately 27 percent of the US population have two or more concurrent comorbid conditions. Traditional models for assessing the impact of patient demographic and comorbidity burden on patient health outcomes, represented comorbidity conditions by Charlson Comorbidity Index. In this paper, we develop a novel two-way clustering approach combining model-based and weighted K-means clustering methods for characterizing and summarizing a patient's comorbid conditions. Our two-way approach helps reduce the size of the data to a manageable size, thus being practical for big data applications. Another novel aspect of our approach is the ability to handle weighted observations. Assigning weights to observations helps reduce the size of the dataset, thus addressing the scalability challenge of algorithms when dealing with big data. Using the National Inpatient Sample database for 2008-2013, we evaluate the performance of our approach by the use of logistic regression and support vector machine models by applying them to patients whose primary diagnosis is cardiovascular disease. In addition to evaluating our proposed method using empirical test data, we use asymptotic statistics. Both evaluation methods show that the proposed approach improves the prediction of patient health outcomes; specifically, hospital length of stay.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available