期刊
MULTIVARIATE BEHAVIORAL RESEARCH
卷 56, 期 2, 页码 224-242出版社
ROUTLEDGE JOURNALS, TAYLOR & FRANCIS LTD
DOI: 10.1080/00273171.2019.1616526
关键词
Network analysis; network theory of mental disorders; psychopathology networks; conditional independence; replicability crisis
类别
资金
- Australian Research Council [FL15010096]
- U.S. National Institutes of Health [L30 MH101760 R01AG053217, AA025689, U19AG051426]
- Macquarie University Research Fellowship from Macquarie University
- Templeton Foundation
Pairwise Markov random field networks, including Gaussian graphical models and Ising models, have become the state-of-the-art method for psychopathology network analyses. Recent research focuses on the reliability and replicability of these networks. Comparison between existing methods for maximizing network stability and consistency, as well as directly comparing detailed network characteristics, reveals discrepancies in the degree of replication.
Pairwise Markov random field networks-including Gaussian graphical models (GGMs) and Ising models-have become the state-of-the-art method for psychopathology network analyses. Recent research has focused on the reliability and replicability of these networks. In the present study, we compared the existing suite of methods for maximizing and quantifying the stability and consistency of PMRF networks (i.e., lasso regularization, plus the bootnet and NetworkComparisonTest packages in R) with a set of metrics for directly comparing the detailed network characteristics interpreted in the literature (e.g., the presence, absence, sign, and strength of each individual edge). We compared GGMs of depression and anxiety symptoms in two waves of data from an observational study (n = 403) and reanalyzed four posttraumatic stress disorder GGMs from a recent study of network replicability. Taken on face value, the existing suite of methods indicated that overall the network edges were stable, interpretable, and consistent between networks, but the direct metrics of replication indicated that this was not the case (e.g., 39-49% of the edges in each network were unreplicated across the pairwise comparisons). We discuss reasons for these apparently contradictory results (e.g., relying on global summary statistics versus examining the detailed characteristics interpreted in the literature) and conclude that the limited reliability of the detailed characteristics of networks observed here is likely to be common in practice, but overlooked by current methods. Poor replicability underpins our concern surrounding the use of these methods, given that generalizable conclusions are fundamental to the utility of their results.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据