A warning threshold for monitoring tuberculosis surveillance data: an alternative to hidden Markov model

OBJECTIVES Although hidden Markov model (HMM) is known as a powerful tool for the detection of epidemics based on the historical data, the frequent use of such a model poses some limitation especially when decision-making is required for new observations. This study was aimed to address a warning threshold for monitoring the weekly incidences of tuberculosis as an alternative to HMM. METHODS We extracted the weekly counts of newly diagnosed patients with sputum smear-positive pulmonary TB from 2005 to 2011 nationwide. To detect unexpected incidences of the disease, two approaches: Serfling and HMM, were applied in presence/absence of linear, seasonal and autoregressive components. Models were subsequently evaluated in terms of goodness of fit, and their results were compared in detection of the disease phases. Then, multiple hypothetical thresholds were constructed based on the estimate of models and the optimal one was revealed through ROC curve analysis. RESULTS Findings from both adjusted R-square ((R) over tilde (2)) and Bayesian information criterion (BIC) presented a higher goodness of fit for periodic autoregressive HMM (BIC = -1323.6; (R) over tilde (2) = 0: 74) than other models. According to ROC analysis, better values for both Youden's index and area under curve (0. 96 and 0. 98 respectively) were obtained by the threshold based on the estimate of periodic autoregressive model. CONCLUSIONS As the optimal threshold presented in this study is simple in concept and has no limitation in practice, especially for monitoring new observations, we would recommend such a threshold to be used for monitoring of TB incidence data in the surveillance system.