Application and Validation of a Seasonal Ensemble Prediction System Using a Dynamic Malaria Model

Seasonal multimodel forecasts from the Development of a European Multimodel Ensemble System for Seasonal-to-Interannual Prediction (DEMETER) project are used to drive a malaria model and create reforecasts of malaria incidence for Botswana, in southern Africa, in a unique integration of a fully dynamic, process-based malaria model with an ensemble forecasting system. The forecasts are verified against a 20-yr malaria index and compared against reference simulations obtained by driving the malaria model with data from the 40-yr European Centre for Medium-Range Weather Forecasts (ECMWF) Re-Analysis (ERA-40). Performance assessment reveals skill in the DEMETER-driven malaria forecasts for prediction of low (below the lower tercile), above-average (above the median), and high (above the upper tercile) malaria events, with the best results obtained for low malaria events [relative operating characteristics (ROC) area = 0.84, 95% confidence interval = 0.63-1.0]. For high malaria events, the DEMETER-driven malaria forecasts are skillful, but the forecasting system performs poorly for those years that it predicts the highest probabilities of a high malaria event. Potential economic value analysis demonstrates the potential value for the DEMETER-driven malaria forecasts over a wide range of user cost-loss ratios, which is primarily due to the ability of the system to save on the cost of action in low malaria years.