4.7 Article

Explainable fMRI-based brain decoding via spatial temporal-pyramid graph convolutional network

期刊

HUMAN BRAIN MAPPING
卷 -, 期 -, 页码 -

出版社

WILEY
DOI: 10.1002/hbm.26255

关键词

brain decoding; brain-inspired models; cognitive tasks; fMRI; graph neural networks; human connectome project; model explainability

向作者/读者索取更多资源

In this study, we propose a biologically inspired architecture called Spatial Temporal-pyramid Graph Convolutional Network (STpGCN) to capture the spatial-temporal graph representation of functional brain activities for high brain decoding performance. We also introduce a sensitivity analysis method called BrainNetX for better explaining the decoding results. The experimental results show that STpGCN significantly improves brain-decoding performance and successfully annotates task-relevant brain regions.
Brain decoding, aiming to identify the brain states using neural activity, is important for cognitive neuroscience and neural engineering. However, existing machine learning methods for fMRI-based brain decoding either suffer from low classification performance or poor explainability. Here, we address this issue by proposing a biologically inspired architecture, Spatial Temporal-pyramid Graph Convolutional Network (STpGCN), to capture the spatial-temporal graph representation of functional brain activities. By designing multi-scale spatial-temporal pathways and bottom-up pathways that mimic the information process and temporal integration in the brain, STpGCN is capable of explicitly utilizing the multi-scale temporal dependency of brain activities via graph, thereby achieving high brain decoding performance. Additionally, we propose a sensitivity analysis method called BrainNetX to better explain the decoding results by automatically annotating task-related brain regions from the brain-network standpoint. We conduct extensive experiments on fMRI data under 23 cognitive tasks from Human Connectome Project (HCP) S1200. The results show that STpGCN significantly improves brain-decoding performance compared to competing baseline models; BrainNetX successfully annotates task-relevant brain regions. Post hoc analysis based on these regions further validates that the hierarchical structure in STpGCN significantly contributes to the explainability, robustness and generalization of the model. Our methods not only provide insights into information representation in the brain under multiple cognitive tasks but also indicate a bright future for fMRI-based brain decoding.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据