Concordance between self-reports and Medicare claims among participants in a national study of chronic disease self-management program

Objectives: To evaluate the concordance between self-reported data and variables obtained from Medicare administrative data in terms of chronic conditions and health care utilization. Design: Retrospective observational study. Participants: We analyzed data from a sample of Medicare beneficiaries who were part of the National Study of Chronic Disease Self-Management Program (CDSMP) and were eligible for the Centers for Medicare and Medicaid Services (CMS) pilot evaluation of CDSMP (n =119). Methods: Self-reported and Medicare claims -based chronic conditions and health care utilization were examined. Percent of consistent numbers, kappa statistic (K), and Pearson's correlation coefficient were used to evaluate concordance. Results: The two data sources had substantial agreement for diabetes and chronic obstructive pulmonary disease (COPD) (kappa = 0.75 and kappa = 0.60, respectively), moderate agreement for cancer and heart disease (kappa = 0.50 and kappa = 0.47, respectively), and fair agreement for depression (kappa = 0.26). With respect to health care utilization, the two data sources had almost perfect or substantial concordance for number of hospitalizations (kappa = 0.69-0.79), moderate concordance for ED care utilization (kappa = 0.45-0.61), and generally low agreement for number of physician visits (kappa <= 0.31). Conclusion: Either self-reports or claim-based administrative data for diabetes, COPD, and hospitalizations can be used to analyze Medicare beneficiaries in the US. Yet, caution must be taken when only one data source is available for other types of chronic conditions and health care utilization.