External validation and update of the J-ACCESS model in an Italian cohort of patients undergoing stress myocardial perfusion imaging

Background. Cardiovascular risk models are based on traditional risk factors and investigations such as imaging tests. External validation is important to determine reproducibility and generalizability of a prediction model. We performed an external validation of t the Japanese Assessment of Cardiac Events and Survival Study by Quantitative Gated SPECT (J-ACCESS) model, developed from a cohort of patients undergoing stress myocardial perfusion imaging.Methods. We included 3623 patients with suspected or known coronary artery disease undergoing stress single-photon emission computer tomography (SPECT) myocardial perfusion imaging at our academic center between January 2001 and December 2019.Results. In our study population, the J-ACCESS model underestimated the risk of major adverse cardiac events (cardiac death, nonfatal myocardial infarction, and severe heart failure requiring hospitalization) within three-year follow-up. The recalibrations and updated of the model slightly improved the initial performance: C-statistics increased from 0.664 to 0.666 and Brier score decreased from 0.075 to 0.073. Hosmer-Lemeshow test indicated a logistic regression fit only for the calibration slope (P = .45) and updated model (P = .22). In the update model, the intercept, diabetes, and severity of myocardial perfusion defects categorized coefficients were comparable with J-ACCESS.Conclusion. The external validation of the J-ACCESS model as well as recalibration models have a limited value for predicting of three-year major adverse cardiac events in our patients. The performance in predicting risk of the updated model resulted superimposable to the calibration slope model.

Automated summary

An external validation of the J-ACCESS model showed that it underestimated the risk of major adverse cardiac events within three-year follow-up in our study population. The recalibrations and updates of the model slightly improved its performance, but limitations still exist.