期刊
MATHEMATICS
卷 10, 期 24, 页码 -出版社
MDPI
DOI: 10.3390/math10244775
关键词
Bayesian inference; filtering; free energy; decision making; predictive coding; volatility
类别
资金
- National Science and Technology Innovation 2030 Major Program of China
- [2022ZD0205000]
This study develops a hierarchical Bayesian model for inference and decision making in multi-dimensional volatile environments. Simulation results demonstrate that the model is able to infer and update the agent's internal belief about sensory inputs, and the agent can generate near-optimal behavior based on the internal belief.
The ability to track the changes of the surrounding environment is critical for humans and animals to adapt their behaviors. In high-dimensional environments, the interactions between each dimension need to be estimated for better perception and decision making, for example in volatile or social cognition tasks. We develop a hierarchical Bayesian model for inferring and decision making in multi-dimensional volatile environments. The hierarchical Bayesian model is composed of a hierarchical perceptual model and a response model. Using the variational Bayes method, we derived closed-form update rules. These update rules also constitute a complete predictive coding scheme. To validate the effectiveness of the model in multi-dimensional volatile environments, we defined a probabilistic gambling task modified from a two-armed bandit. Simulation results demonstrated that an agent endowed with the proposed hierarchical Bayesian model is able to infer and to update its internal belief on the tendency and volatility of the sensory inputs. Based on the internal belief of the sensory inputs, the agent yielded near-optimal behavior following its response model. Our results pointed this model a viable framework to explain the temporal dynamics of human decision behavior in complex and high dimensional environments.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据