Psychology, Mathematical

Article Psychology, Mathematical

Data quality of platforms and panels for online behavioral research

Peer Eyal, Rothschild David, Gordon Andrew, Evernden Zak, Damer Ekaterina

Summary: The study found significant differences in data quality aspects among different platforms and panels in online behavioral research, especially in comprehension, attention, and honesty. Reputation could not predict data quality, but frequency and purpose of usage did, especially on MTurk.

BEHAVIOR RESEARCH METHODS (2022)

Article Psychology, Mathematical

Eye tracking: empirical foundations for a minimal reporting guideline

Kenneth Holmqvist, Saga Lee Oerbom, Ignace T. C. Hooge, Diederick C. Niehorster, Robert G. Alexander, Richard Andersson, Jeroen S. Benjamins, Pieter Blignaut, Anne-Marie Brouwer, Lewis L. Chuang, Kirsten A. Dalrymple, Denis Drieghe, Matt J. Dunn, Ulrich Ettinger, Susann Fiedler, Tom Foulsham, Jos N. van der Geest, Dan Witzner Hansen, Samuel B. Hutton, Enkelejda Kasneci, Alan Kingstone, Paul C. Knox, Ellen M. Kok, Helena Lee, Joy Yeonjoo Lee, Jukka M. Leppanen, Stephen Macknik, Paivi Majaranta, Susana Martinez-Conde, Antje Nuthmann, Marcus Nystrom, Jacob L. Orquin, Jorge Otero-Millan, Soon Young Park, Stanislav Popelka, Frank Proudlock, Frank Renkewitz, Austin Roorda, Michael Schulte-Mecklenbeck, Bonita Sharif, Frederick Shic, Mark Shovman, Mervyn G. Thomas, Ward Venrooij, Raimondas Zemblys, Roy S. Hessels

Summary: This article reviews the impact of various aspects of eye-tracking studies, including the instrument used, methodology, environment, and participants, on the quality of recorded eye-tracking data and obtained eye-movement and gaze measures. It compares existing reporting guidelines with empirical research and published studies and reveals significant variations and inconsistencies. A minimal and flexible reporting guideline is derived based on empirical findings.

BEHAVIOR RESEARCH METHODS (2022)

Article Mathematics, Interdisciplinary Applications

A step-by-step tutorial on active inference and its application to empirical data

Ryan Smith, Karl J. Friston, Christopher J. Whyte

Summary: The active inference framework, particularly its formulation as a POMDP, has become increasingly popular for modeling neurocognitive processes. This paper provides a step-by-step tutorial on building POMDPs, running simulations, and fitting models to empirical data. It aims to equip the reader with the necessary background and tools to apply active inference to their own research.

JOURNAL OF MATHEMATICAL PSYCHOLOGY (2022)

Article Psychology, Mathematical

lab.js: A free, open, online study builder

Felix Henninger, Yury Shevchenko, Ulf K. Mertens, Pascal J. Kieslich, Benjamin E. Hilbig

Summary: lab.js is a free, open-source experiment builder that allows researchers to easily build studies for both online and laboratory data collection through a visual interface without programming. It provides high accuracy and precision in measuring presentation and response times, while also allowing customization of study appearance and behavior using html, css, and JavaScript code if needed. Experiments constructed with lab.js can be run locally or published online with ease, integrating with popular data collection platforms for transparent replications and facilitating open, cumulative science.

BEHAVIOR RESEARCH METHODS (2022)

Review Psychology, Mathematical

How does bilingualism modify cognitive function? Attention to the mechanism

Ellen Bialystok, Fergus I. M. Craik

Summary: The claim that bilingual experience enhances cognitive control has been investigated through studies comparing monolingual and bilingual groups performing executive function tasks. Inconsistent results have led to controversy over whether bilingualism produces cognitive change. This paper argues that the inconsistency lies in the framework used to interpret the results and proposes a more holistic account based on attentional control. The authors suggest that behavioral differences between monolingual and bilingual individuals reflect differences in attentional control efficiency and deployment.

PSYCHONOMIC BULLETIN & REVIEW (2022)

Article Psychology, Mathematical

Thinking thrice about sum scores, and then some more about measurement and analysis

Keith F. Widaman, William Revelle

Summary: Measurement is fundamental to psychology research and should be scrutinized more closely. The use of sum scores in psychological research is often reliable, especially when the dimensional structure of the items is validated.

BEHAVIOR RESEARCH METHODS (2023)

Article Psychology, Mathematical

SOLOMON: a method for splitting a sample into equivalent subsamples in factor analysis

Urbano Lorenzo-Seva

Summary: Exploratory factor analysis and confirmatory factor analysis are two important consecutive steps in the overall analysis process. Researchers split a single sample into two halves using a random split method to conduct the analysis. This paper introduces a new method of splitting samples for factor analysis, which has been tested in simulation studies and real datasets.

BEHAVIOR RESEARCH METHODS (2022)

Article Psychology, Educational

Sample Size Requirements for Simple and Complex Mediation Models

Mikyung Sim, Su-Young Kim, Youngsuk Suh

Summary: This study investigated the sample size requirements for four commonly used mediation models through Monte Carlo simulations under various simulation conditions. The results provide practical guidelines for substantive researchers to determine the minimum required sample sizes and enhance understanding of factors related to sample size requirements in mediation models.

EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT (2022)

Article Psychology, Mathematical

Best research practices for using the Implicit Association Test

Anthony G. Greenwald, Miguel Brendl, Huajian Cai, Dario Cvencek, John F. Dovidio, Malte Friese, Adam Hahn, Eric Hehman, Wilhelm Hofmann, Sean Hughes, Ian Hussey, Christian Jordan, Teri A. Kirby, Calvin K. Lai, Jonas W. B. Lang, Kristen P. Lindgren, Dominika Maison, Brian D. Ostafin, James R. Rae, Kate A. Ratliff, Adriaan Spruyt, Reinout W. Wiers

Summary: This article discusses the best practices for research using the Implicit Association Test (IAT) and provides recommendations on how to report procedures of IAT measures in empirical articles.

BEHAVIOR RESEARCH METHODS (2022)

Article Psychology, Mathematical

Quality control questions on Amazon's Mechanical Turk (MTurk): A randomized trial of impact on the USAUDIT, PHQ-9, and GAD-7

Jon Agley, Yunyu Xiao, Rachael Nolan, Lilian Golzarri-Arroyo

Summary: This study investigated the impact of different quality control checks on the outcome scores of three common screening tools among MTurk workers. The results showed that the use of quality control measures significantly affected the outcome scores of the screening tools, suggesting that quality control questions can have a substantive impact on research findings.

BEHAVIOR RESEARCH METHODS (2022)

Article Psychology, Mathematical

Expanding horizons of cross-linguistic research on reading: The Multilingual Eye-movement Corpus (MECO)

Noam Siegelman, Sascha Schroeder, Cengiz Acartuerk, Hee-Don Ahn, Svetlana Alexeeva, Simona Amenta, Raymond Bertram, Rolando Bonandrini, Marc Brysbaert, Daria Chernova, Sara Maria Da Fonseca, Nicolas Dirix, Wouter Duyck, Argyro Fella, Ram Frost, Carolina A. Gattei, Areti Kalaitzi, Nayoung Kwon, Kaidi Loo, Marco Marelli, Timothy C. Papadopoulos, Athanassios Protopapas, Satu Savo, Diego E. Shalom, Natalia Slioussar, Roni Stein, Longjiao Sui, Anali Taboh, Veronica Tonnesen, Kerem Alp Usal, Victor Kuperman

Summary: This paper presents a study on eye-tracking data of reading behaviors in 13 languages, revealing differences in skipping rates and stable behaviors across different languages. The findings have important implications for theories of reading.

BEHAVIOR RESEARCH METHODS (2022)

Article Mathematics, Interdisciplinary Applications

Meta-analytic Gaussian Network Aggregation

Sacha Epskamp, Adela-Maria Isvoranu, Mike W. L. Cheung

Summary: This study introduces a method for estimating GGM by aggregating multiple datasets, discussing fixed-effects and random-effects MAGNA models, evaluating their performance in large-scale simulation studies, and exemplifying the method using four PTSD symptom datasets, summarizing findings from a larger meta-analysis of PTSD symptoms.

PSYCHOMETRIKA (2022)

Review Psychology, Mathematical

Behavioral paradigms for studying pro-environmental behavior: A systematic review

Florian Lange

Summary: In this review, various behavioral paradigms for studying pro-environmental behavior in different domains are introduced to help researchers across disciplines select suitable paradigms for their own research.

BEHAVIOR RESEARCH METHODS (2023)

Article Psychology, Mathematical

The Work for Environmental Protection Task: A consequential web-based procedure for studying pro-environmental behavior

Florian Lange, Siegfried Dewitte

Summary: Some human behaviors with serious societal consequences are often neglected in online research. A new web-based procedure, the Work for Environmental Protection Task (WEPT), has been developed to study consequential pro-environmental behavior, with validation studies showing promising results in measuring actual behaviors and their impacts. The WEPT may present a valuable tool for experimental analysis of pro-environmental behavior and addressing common-method variance in individual difference research, potentially adaptable for studying other societally relevant behaviors.

BEHAVIOR RESEARCH METHODS (2022)

Review Psychology, Mathematical

Examining the relations between spatial skills and mathematical performance: A meta-analysis

Kinnari Atit, Jason Richard Power, Terri Pigott, Jihyun Lee, Elyssa A. Geer, David H. Uttal, Colleen M. Ganley, Sheryl A. Sorby

Summary: Recent research has focused on the relationship between spatial skills and mathematical skills. The findings show a positive moderate association between the two skills, with gender and grade-level not significantly affecting this relationship. Fluid reasoning and verbal skills mediate the relationship between spatial skills and mathematical skills, suggesting a unique connection between the two.

PSYCHONOMIC BULLETIN & REVIEW (2022)

Review Psychology, Mathematical

Methods to split cognitive task data for estimating split-half reliability: A comprehensive review and systematic assessment

Thomas Pronk, Dylan Molenaar, Reinout W. Wiers, Jaap Murre

Summary: This study reviews four different methods for estimating the reliability of cognitive task datasets, and recommends using the Monte Carlo splitting method in combination with task design stratification for the most robust results. The effects of different splitting methods on reliability estimates are discussed based on theoretical analysis.

PSYCHONOMIC BULLETIN & REVIEW (2022)

Article Psychology, Mathematical

The Oxford Face Matching Test: A non-biased test of the full range of individual differences in face perception

Mirta Stantic, Rebecca Brewer, Bradley Duchaine, Michael J. Banissy, Sarah Bate, Tirta Susilo, Caroline Catmur, Geoffrey Bird

Summary: Face processing tests aim to identify individual differences, including prosopagnosic individuals, typical performers, and super recognisers. The Oxford Face Matching Test (OFMT) was developed to measure these differences across the full range of performance using facial recognition algorithms to obtain unbiased face pair similarity ratings. Results indicate that face perception and memory are poor in prosopagnosic individuals and good in super recognisers.

BEHAVIOR RESEARCH METHODS (2022)

Article Mathematics, Interdisciplinary Applications

Time to Intervene: A Continuous-Time Approach to Network Analysis and Centrality

Oisin Ryan, Ellen L. Hamaker

Summary: Network analysis of ESM data in clinical psychology is popular, with researchers using DT-VAR models to define network structure. However, VAR models have time-interval dependency issues. This paper proposes a CT network approach using CT-VAR models, introducing new centrality measures for intervention targeting.

PSYCHOMETRIKA (2022)

Article Psychology, Mathematical

GFMT2: A psychometric measure of face matching ability

David White, Daniel Guilbert, Victor P. L. Varela, Rob Jenkins, A. Mike Burton

Summary: GFMT2 is an expanded version of the widely used Glasgow Face Matching Test, with improvements in variation and difficulty of test items, short and long versions, addressing familiarity confounds, and implementation of tests in an executable program.

BEHAVIOR RESEARCH METHODS (2022)

Article Psychology, Mathematical

A pre-registered, multi-lab non-replication of the action-sentence compatibility effect (ACE)

Richard D. Morey, Michael P. Kaschak, Antonio M. Diez-Alamo, Arthur M. Glenberg, Rolf A. Zwaan, Daniel Lakens, Agustin Ibanez, Adolfo Garcia, Claudia Gianelli, John L. Jones, Julie Madden, Florencia Alifano, Benjamin Bergen, Nicholas G. Bloxsom, Daniel N. Bub, Zhenguang G. Cai, Christopher R. Chartier, Anjan Chatterjee, Erin Conwell, Susan Wagner Cook, Joshua D. Davis, Ellen R. K. Evers, Sandrine Girard, Derek Harter, Franziska Hartung, Eduar Herrera, Falk Huettig, Stacey Humphries, Marie Juanchich, Katharina Kuehne, Shulan Lu, Tom Lynes, Michael E. J. Masson, Markus Ostarek, Sebastiaan Pessers, Rebecca Reglin, Sara Steegen, Erik D. Thiessen, Laura E. Thomas, Sean Trott, Joachim Vandekerckhove, Wolf Vanpaemel, Maria Vlachou, Kristina Williams, Noam Ziv-Crispel

Summary: The Action-sentence Compatibility Effect (ACE) demonstrates the role of motor activity in language comprehension, showing that movements are faster when the direction matches the action described in the sentence.

PSYCHONOMIC BULLETIN & REVIEW (2022)