Raising the bar: improving methodological rigour in cognitive alcohol research

Background and Aims A range of experimental paradigms claim to measure the cognitive processes underpinning alcohol use, suggesting that heightened attentional bias, greater approach tendencies and reduced cue-specific inhibitory control are important drivers of consumption. This paper identifies methodological shortcomings within this broad domain of research and exemplifies them in studies focused specifically on alcohol-related attentional bias. Argument and analysis We highlight five main methodological issues: (i) the use of inappropriately matched control stimuli; (ii) opacity of stimulus selection and validation procedures; (iii) a credence in noisy measures; (iv) a reliance on unreliable tasks; and (v) variability in design and analysis. This is evidenced through a review of alcohol-related attentional bias (64 empirical articles, 68 tasks), which reveals the following: only 53% of tasks use appropriately matched control stimuli; as few as 38% report their stimulus selection and 19% their validation procedures; less than 28% used indices capable of disambiguating attentional processes; 22% assess reliability; and under 2% of studies were pre-registered. Conclusions Well-matched and validated experimental stimuli, the development of reliable cognitive tasks and explicit assessment of their psychometric properties, and careful consideration of behavioural indices and their analysis will improve the methodological rigour of cognitive alcohol research. Open science principles can facilitate replication and reproducibility in alcohol research.

Automated summary

This paper highlights five main methodological issues in studies related to alcohol-related attentional bias, including the use of inappropriately matched control stimuli, opacity of stimulus selection and validation procedures, reliance on unreliable tasks, and variability in design and analysis. The review of alcohol-related attentional bias research reveals low methodological rigor in this area, indicating a need for improved experimental stimuli, reliable cognitive tasks, and careful consideration of behavioral indices and analysis for future studies in cognitive alcohol research.