4.5 Article

Estimating extremely large amounts of missing precipitation data

Journal

JOURNAL OF HYDROINFORMATICS
Volume 22, Issue 3, Pages 578-592

Publisher

IWA PUBLISHING
DOI: 10.2166/hydro.2020.127

Keywords

evaluation; large missing precipitation; multiple imputation; random forest; spatio-temporal kriging

Funding

  1. CLIGRO Project (MICINN) of the Spanish National Plan for Scientific and Technical Research and Innovation [CGL2016-77473-C3-1-R]
  2. National System of Youth Guarantee [PEJ-2014-85121]
  3. Youth Employment Initiative (YEI)
  4. European Social Fund (ESF)
  5. Ministry of Education, Youth and Sport of the Community of Madrid [IND2017/AMB7789]

Ask authors/readers for more resources

Accurate estimation of missing daily precipitation data remains a difficult task. A wide variety of methods exists for infilling missing values, but the percentage of gaps is one of the main factors limiting their applicability. The present study compares three techniques for filling in large amounts of missing daily precipitation data: spatio-temporal kriging (STK), multiple imputation by chained equations through predictive mean matching (PMM), and the random forest (RF) machine learning algorithm. To our knowledge, this is the first time that extreme missingness (>90%) has been considered. Different percentages of missing data and missing patterns are tested in a large dataset drawn from 112 rain gauges in the period 1975-2017. The results show that both STK and RF can handle extreme missingness, while PMM requires larger observed sample sizes. STK is the most robust method, suitable for chronological missing patterns. RF is efficient under random missing patterns. Model evaluation is usually based on performance and error measures. However, this study outlines the risk of just relying on these measures without checking for consistency. The RF algorithm overestimated daily precipitation outside the validation period in some cases due to the overdetection of rainy days under time-dependent missing patterns.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.5
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available