Observed vs. self-reported agricultural activities: Evaluating 24-hr recall in a pilot study

Few studies have evaluated the validity of self-report of work activities because of challenges in obtaining objective measures. In this study, farmers' recall of the previous day's agricultural activities was compared to activities observed by field staff during air monitoring. Recall was assessed in 32 farmers from the Biomarkers of Exposure and Effect in Agriculture Study, a subset of a prospective cohort study. The farmers participated in 56 visits that comprised air monitoring the day before an interview. The answers for 14 agricultural activities were compared to activities observed by field staff during air monitoring (median duration 380 min, range 129-486). For each task, evaluated as yes/no, overall agreement, sensitivity, specificity, and kappa were calculated. Median prevalence of the 14 activities was 8% from observation and 13% from participants (range: 2-54%). Agreement was generally good to perfect, with a median overall agreement of 95% (range: 89-100%), median sensitivity of 84% (50-100%), median specificity of 95% (88-100%), and median kappa of 0.65 (0.31-1.0). Reasons for disagreement included activities occurring when the field staff was not present (i.e., milking cows), unclear timing notes that made it difficult to determine whether the activity occurred the day of and/or day before the interview, definition issues (i.e., participant included hauling in the definition of harvesting), and difficulty in observing details of an activity (i.e., whether hay was moldy). This study provides support for accurate participant recall the day after activities.

Automated summary

This study evaluated the validity of farmers' self-report of work activities by comparing their recall to activities observed by field staff during air monitoring. The results showed generally good agreement between the two sources, with discrepancies primarily due to activities not being observed or timing issues.