Journal
JOURNAL OF NEUROSCIENCE METHODS
Volume 274, Issue -, Pages 81-93Publisher
ELSEVIER SCIENCE BV
DOI: 10.1016/j.jneumeth.2016.10.002
Keywords
Executive functions; Reliability; Validity; Antisaccade; Flanker; Simon; Switching
Categories
Ask authors/readers for more resources
Background: Studies testing for individual or group differences in executive functioning can be compromised by unknown test-retest reliability. New method: Test-retest reliabilities across an interval of about one week were obtained from performance in the antisaccade, flanker, Simon, and color-shape switching tasks. There is a general trade-off between the greater reliability of single mean RT measures, and the greater process purity of measures based on contrasts between mean RTs in two conditions. The individual differences in RT model recently developed by Miller and Ulrich was used to evaluate the trade-off. Results: Test-retest reliability was statistically significant for 11 of the 12 measures, but was of moderate size, at best, for the difference scores. The test-retest reliabilities for the Simon and flanker interference scores were lower than those for switching costs. Comparison with existing methods: Standard practice evaluates the reliability of executive-functioning measures using split-half methods based on data obtained in a single day. Our test-retest measures of reliability are lower, especially for difference scores. These reliability measures must also take into account possible day effects that classical test theory assumes do not occur. Conclusions: Measures based on single mean RTs tend to have acceptable levels of reliability and convergent validity, but are impure measures of specific executive functions. The individual differences in RT model shows that the impurity problem is worse than typically assumed. However, the purer measures based on difference scores have low convergent validity that is partly caused by deficiencies in test-retest reliability. (C) 2016 Elsevier B.V. All rights reserved.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available