4.6 Article

The look-elsewhere effect from a unified Bayesian and frequentist perspective

出版社

IOP Publishing Ltd
DOI: 10.1088/1475-7516/2020/10/009

关键词

dark matter experiments; gravitational waves / experiments; non-gaussianity; particle acceleration

资金

  1. U.S. Department of Energy Office of Science User Facility [DEAC02-05CH11231]
  2. National Science Foundation [1814370, NSF 1839217]
  3. NASA [80NSSC18K1274]
  4. Direct For Mathematical & Physical Scien
  5. Division Of Astronomical Sciences [1814370] Funding Source: National Science Foundation

向作者/读者索取更多资源

When searching over a large parameter space for anomalies such as events, peaks, objects, or particles, there is a large probability that spurious signals with seemingly high significance will be found. This is known as the look-elsewhere effect and is prevalent throughout cosmology, (astro)particle physics, and beyond. To avoid making false claims of detection, one must account for this effect when assigning the statistical significance of an anomaly. This is typically accomplished by considering the trials factor, which is generally computed numerically via potentially expensive simulations. In this paper we develop a continuous generalization of the Bonferroni and Sidak corrections by applying the Laplace approximation to evaluate the Bayes factor, and in turn relating the trials factor to the prior-to-posterior volume ratio. We use this to define a test statistic whose frequentist properties have a simple interpretation in terms of the global p-value, or statistical significance. We apply this method to various physics-based examples and show it to work well for the full range of p-values, i.e. in both the asymptotic and non-asymptotic regimes. We also show that this method naturally accounts for other model complexities such as additional degrees of freedom, generalizing Wilks' theorem. This provides a fast way to quantify statistical significance in light of the look-elsewhere effect, without resorting to expensive simulations.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.6
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据