4.3 Article

Analyzing the reliability of multidimensional measures: An example from intelligence research

Journal

EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT
Volume 65, Issue 2, Pages 227-240

Publisher

SAGE PUBLICATIONS INC
DOI: 10.1177/0013164404268669

Keywords

reliability analysis; confirmatory factor analysis; multidimensional measures; hierarchical factor models

Ask authors/readers for more resources

Two aspects of the reliability of multidimensional measures can be distinguished: the amount of scale score variance that is accounted for by all underlying factors (composite reliability) and the degree to which the scale score reflects one particular factor (construct reliability). Confidence intervals for composite and construct reliabilities can be estimated by bootstrap methods. The authors demonstrate the application of these methods by analyzing the reliability of an eight-factor, nested-factor model that represents the structure of 45 tasks in an intelligence test (N = 1,233). Composite reliabilities ranged between .78 and .93, whereas construct reliabilities ranged between. 17 and .68 when the scale indicators were equally weighted to compute the scale scores and between .52 and .90 with weights based on pattern coefficients. The results indicate the importance of distinguishing diagnostic from research applications when judging whether the reliability values of multidimensional measures are substantial.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.3
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available