Towards a Validation Methodology for Macroeconomic Agent-Based Models

Agent-based models provide a promising new tool in macroeconomic research. Questions have been raised, however, regarding the validity of such models. A methodology of macroeconomic agent-based model (MABM) validation, that provides a deeper understanding of validation practices, is required. This paper takes steps towards such a methodology by connecting three elements. First, is a foundation of model validation in general. Second is a classification of models dependent on how the model is validated. An important distinction in this classification is the difference between mechanism and target validation. Third, is a framework that revolves around the relationship between the structure of models of complex systems with emergent properties and validation in practice. Important in this framework is to consider MABMs as modelling multiple non-trivial levels. Connecting these three elements provides us with a methodology of the validation of MABMs and allows us to come to the following conclusions regarding MABM validation. First, in MABMs, mechanisms at a lower level are distinct from, but provide input to higher levels of mechanisms. Since mechanisms at different levels are validated in different ways we can come to a specific characterization of MABMs within the model classification framework. Second, because the mechanisms of MABMs are validated in a direct way at the level of the agent, MABMs can be seen as a move towards a more realist approach to modelling compared to DSGE.

Automated summary

This paper discusses a methodology for validating macroeconomic agent-based models, focusing on the foundation of model validation, model classification, and the relationship between model structure and validation in practice. By connecting these three elements, two key characteristics of MABM validation are identified: mechanisms at different levels are validated independently, and the mechanisms of MABMs are directly validated at the agent level, making them more realistic compared to DSGE models.