Validity and Reliability of Behavior and Theory-Based Psychosocial Determinants Measures, Using Audience Response System Technology in Urban Upper-Elementary Schoolchildren

Objective: To examine the validity and reliability of a questionnaire administered with an audience response system (ARS). Design: Cross-sectional study. Setting: Two New York City public elementary schools. Participants: Fourth-and fifth-grade students. Main Outcome Measures: A Food, Health, and Choices questionnaire (FHC-Q) assessed energy balance-related behaviors (EBRBs) including intake of fruits and vegetables, sugar-sweetened beverages, processed packaged snacks, and fast food; physical activity; recreational screen time; and associated psychosocial determinants (>= 3 questions/outcome scale). Previously validated reference instruments were used for relative validation. The ARS format was compared with a paper-and-pencil format. All measures were administered in a classroom setting. Analysis: Pearson correlation coefficients between the reference instruments and the FHC-Q were calculated. Internal consistency reliabilities were evaluated with Cronbach alpha. Spearman rank correlation, intra-class correlation, and percent agreement were used for test-retest reliability between paper-and-pencil and ARS, and between 2 ARS FHC-Q administrations. Results: Correlations for EBRBs with reference instruments ranged from 0.38 to 0.61 (P < .01). Cron-bach alpha ranged from .77 to .92 for EBRBs and .74 to .90 for psychosocial determinants. Test-retest reliability correlations ranged from 0.36 to 0.87 (P < .001). Agreement for knowledge questions ranged from 69.8% to 84.8%. Conclusions and Implications: The ARS FHC-Q has acceptable validity and reliability for collecting data on EBRBs and associated psychosocial determinants for upper-elementary students.