Journal
RELIABILITY ENGINEERING & SYSTEM SAFETY
Volume 93, Issue 5, Pages 657-674Publisher
ELSEVIER SCI LTD
DOI: 10.1016/j.ress.2007.03.005
Keywords
expert judgment; rational consensus; calibration; information; subjective probability
Ask authors/readers for more resources
We review the applications of structured expert judgment uncertainty quantification using the classical model developed at the Delft University of Technology over the last 17 years [Cooke RM. Experts in uncertainty. Oxford: Oxford University Press; 1991; Expert judgment study on atmospheric dispersion and deposition. Report Faculty of Technical Mathematics and Informatics No.01-81, Delft University of Technology; 1991]. These involve 45 expert panels, performed under contract with problem owners who reviewed and approved the results. With a few exceptions, all these applications involved the use of seed variables; that is, variables from the experts' area of expertise for which the true values are available post hoc. Seed variables are used to (1) measure expert performance, (2) enable performance-based weighted combination of experts' distributions, and (3) evaluate and hopefully validate the resulting combination or decision maker. This article reviews the classical model for structured expert judgment and the performance measures, reviews applications, comparing performance-based decision makers with equal weight decision makers, and collects some lessons learned. (c) 2007 Elsevier Ltd. All rights reserved.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available