4.6 Article

An Intercomparison of Sampling Methods for Uncertainty Quantification of Environmental Dynamic Models

Journal

JOURNAL OF ENVIRONMENTAL INFORMATICS
Volume 28, Issue 1, Pages 11-24

Publisher

INT SOC ENVIRON INFORM SCI
DOI: 10.3808/jei.201500310

Keywords

design of experiment; quasi Monte-Carlo; sampling methods; symmetric Latin hypercube; uniform design

Funding

  1. Chinese Ministry of Science and Technology 973 Research Program [2015CB953703]
  2. Special Fund for Meteorological Scientific Research in Public Interest [GYHY201506002, CRAsimilar to40]
  3. Natural Science Foundation of China [41075075, 41375139, 51309011]
  4. Fundamental Research Funds for the Central Universities - Beijing Normal University Research Fund [2013YB47]

Ask authors/readers for more resources

Uncertainty quantification (UQ) of environmental dynamic models requires an efficient way to extract the information about the relationship between input parameter and model output. A uniformly scattered sample set is generally preferred over crude Monte Carlo sampling for its ability to explore the parameter space more effectively and efficiently. This paper compares eight commonly used uniform sampling methods along with the crude Monte Carlo sampling. The efficiency is measured by six uniformity metrics, while the effectiveness is measured by the goodness-of-fit of the surrogate models, and the sensitivity analysis and optimization results. We used two test problems: the Sobol' g-function and the SAC-SMA hydrological model. The results show that among the sampling methods evaluated, the Good Lattice Points (GLP) and Symmetric Latin hypercube (SLH) have the highest uniformity scores, and the Ranked Gram-Schmidt (RGS) de-correlation algorithm can further improve the uniformity of the lattice sample sets. On the other hand, the Quasi-Monte-Carlo (QMC) methods, such as Halton and Sobol' sequences, are not as uniform as their theoretical potential suggests when the number of sample points is low. Further, we found no clear relationship between the sampling methods used and their effectiveness, as the latter is affected by many factors other than the sampling methods, such as the choice of the surrogate modeling methods, sensitivity analysis and optimization methods, and the intrinsic properties of the dynamic models.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available