Partitioning Degrees of Freedom in Hierarchical and Other Richly Parameterized Models

Hodges and Sargent (2001) have developed a measure of a hierarchical model's complexity, degrees of freedom (DF), that is consistent with definitions for scatterplot smoothers, is interpretable in terms of simple models, and enables control of a lit's complexity by means of a prior distribution on complexity. But although OF describes the complexity of the whole fitted model, in general it remains unclear how to allocate OF to individual effects. Here we present a new definition of OF for arbitrary normal-error linear hierarchical models, consistent with that of Hodges and Sargent, that naturally partitions the n observations into DF for individual effects and for error. The new conception of an effect's DF is the ratio of the effect's modeled variance matrix to the total variance matrix. This provides a way to describe the sizes of different parts of a model (e.g., spatial clustering vs. heterogeneity), to place DF-based priors on smoothing parameters, and to describe how a smoothed effect competes with other effects. It also avoids difficulties with the most common definition of OF for residuals. We conclude by comparing OF with the effective number of parameters. Pp, of Spiegelhalter et al, (2002). Technical appendices and a data set are available on as supplemental materials.