Psychology, Mathematical

Article Psychology, Educational

A Multilevel Mixture IRT Framework for Modeling Response Times as Predictors or Indicators of Response Engagement in IRT Models

Gabriel Nagy, Esther Ulitzsch

Summary: The article discusses procedures and IRT models based on response times, proposes a distinction between independent and dependent latent class IRT models, and summarizes and extends existing models. It ultimately introduces a flexible multilevel mixture IRT framework and presents the results.

EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT (2022)

Article Psychology, Mathematical

Evaluating CloudResearch's Approved Group as a solution for problematic data quality on MTurk

David J. Hauser, Aaron J. Moss, Cheskie Rosenzweig, Shalom N. Jaffe, Jonathan Robinson, Leib Litman

Summary: Maintaining data quality has always been a concern on Amazon Mechanical Turk (MTurk). CloudResearch assessed MTurkers and categorized them into high- and low-quality data providers, finding that the high-quality group performed better on various measures.

BEHAVIOR RESEARCH METHODS (2022)

Review Psychology, Mathematical

What processes are disrupted during the attentional blink? An integrative review of event-related potential research

Alon Zivony, Dominique Lamy

Summary: Research has shown that failure to report the second target is primarily due to disrupted attentional engagement, characterized by a smaller and delayed N2pc component. This disruption occurs after early processing of T2, weakens its semantic processing, and prevents its encoding into working memory.

PSYCHONOMIC BULLETIN & REVIEW (2022)

Article Psychology, Educational

Detecting Careless Responding in Survey Data Using Stochastic Gradient Boosting

Ulrich Schroeders, Christoph Schmidt, Timo Gnambs

Summary: This study examines the bias of careless responding in survey responses, which poses a threat to the reliability and validity of psychological measurements. The introduction of gradient boosted trees as a machine learning technique to identify careless respondents outperformed traditional detection mechanisms in simulated studies, but this advantage did not translate to empirical studies. Existing detection methods may not be robust enough to handle the erratic nature of responses in real-world settings, prompting further research in the field.

EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT (2022)

Article Mathematics, Interdisciplinary Applications

A Response-Time-Based Latent Response Mixture Model for Identifying and Modeling Careless and Insufficient Effort Responding in Survey Data

Esther Ulitzsch, Steffi Pohl, Lale Khorramdel, Ulf Kroehne, Matthias von Davier

Summary: Careless and insufficient effort responding (C/IER) poses a threat to data quality and validity of inferences drawn from questionnaire data. A model-based approach is presented to detect various manifestations of C/IER by utilizing response time information and theoretical considerations. The approach considers individual differences in response behavior, allows for variations in attentiveness, and deals with different response patterns arising from C/IER.

PSYCHOMETRIKA (2022)

Article Psychology, Mathematical

Automated evaluation of psychotherapy skills using speech and language technologies

Nikolaos Flemotomos, Victor R. Martinez, Zhuohao Chen, Karan Singla, Victor Ardulov, Raghuveer Peri, Derek D. Caperton, James Gibson, Michael J. Tanana, Panayiotis Georgiou, Jake Van Epps, Sarah P. Lord, Tad Hirsch, Zac E. Imel, David C. Atkins, Shrikanth Narayanan

Summary: With the prevalence of psychological interventions increasing, it is important to have measures in place to assess the effectiveness of psychological care. Traditional quality assessment methods are costly and time-consuming, leading to poor feasibility in real-world settings. Automated competency rating tools have been developed to provide comprehensive feedback to therapists, improving training and ultimately leading to more positive clinical outcomes.

BEHAVIOR RESEARCH METHODS (2022)

Article Mathematics, Interdisciplinary Applications

A comparative evaluation of factor- and component-based structural equation modelling approaches under (in)correct construct representations

Gyeongcheol Cho, Marko Sarstedt, Heungsun Hwang

Summary: Structural equation modelling (SEM) has two domains, factor-based and component-based, each with their own population models. Component-based approaches are generally more robust to construct misrepresentation and should be preferred over factor-based approaches for component models. Among component-based approaches, GSCA is recommended over PLSPM regardless of construct misrepresentation.

BRITISH JOURNAL OF MATHEMATICAL & STATISTICAL PSYCHOLOGY (2022)

Article Psychology, Mathematical

Valence and arousal ratings for 11,310 simplified Chinese words

Xu Xu, Jiayin Li, Huilin Chen

Summary: This study presents valence and arousal ratings for 11,310 simplified Chinese words, validated through comparisons with prior ratings of smaller word samples. The availability of age-of-acquisition and concreteness ratings for a large portion of the words enriches the MELD-SCH database and provides insights into psycholinguistic constructs. Cross-language comparisons suggest cultural and sociopolitical influences on affect representations.

BEHAVIOR RESEARCH METHODS (2022)

Correction Mathematics, Interdisciplinary Applications

META-ANALYTIC GAUSSIAN NETWORK AGGREGATION (July, 10.1007/s11336-021-09764-3, 2021)

Sacha Epskamp, Adela-Maria Isvoranu, Mike W. -L. Cheung

PSYCHOMETRIKA (2022)

Article Psychology, Mathematical

LINCE PLUS software for systematic observational studies in sports and health

Alberto Soto-Fernandez, Oleguer Camerino, Xavier Iglesias, M. Teresa Anguera, Marta Castaner

Summary: LINCE PLUS is a free software program designed for systematic observational studies in sports and health, allowing collaborative work and real-time data analysis display.

BEHAVIOR RESEARCH METHODS (2022)

Article Education & Educational Research

Analyzing Cross-Sectionally Clustered Data Using Generalized Estimating Equations

Francis L. Huang

Summary: This article introduces the generalized estimating equations (GEEs) approach for analyzing clustered data, which is less commonly used in the education field. Through worked examples with continuous and binary outcomes, comparisons are made between GEEs, multilevel models, and ordinary least squares to highlight similarities and differences between the methods. Detailed walkthroughs are provided using both R and SPSS Version 26.

JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS (2022)

Article Psychology, Mathematical

Divergent semantic integration (DSI): Extracting creativity from narratives with distributional semantic modeling

Dan R. Johnson, James C. Kaufman, Brendan S. Baker, John D. Patterson, Baptiste Barbot, Adam E. Green, Janet van Hell, Evan Kennedy, Grace F. Sullivan, Christa L. Taylor, Thomas Ward, Roger E. Beaty

Summary: This study integrates creativity theory and distributional semantics theory to develop a new conceptualization of creativity in narratives, called divergent semantic integration (DSI). Through multiple studies and a large number of narratives, six different models of DSI were compared. The results showed that the DSI scores generated by the BERT model had high predictive power, explaining a significant amount of variance in human creativity ratings and approaching human inter-rater reliability for some tasks.

BEHAVIOR RESEARCH METHODS (2023)

Article Psychology, Mathematical

Methods in cognitive pupillometry: Design, preprocessing, and statistical analysis

Sebastiaan Mathot, Ana Vilotijevic

Summary: Cognitive pupillometry is a method that involves measuring pupil size to investigate cognitive processes. However, there is currently no consensus on the methodology for conducting such experiments, leading to variations in approaches between research groups and even within the same group. This article provides a comprehensive guide to methods in cognitive pupillometry, covering experimental design, preprocessing of data, and statistical techniques. Code and toolboxes are also provided for preprocessing and statistical analysis, along with example experiments and scripts.

BEHAVIOR RESEARCH METHODS (2023)

Article Psychology, Mathematical

Estimating group differences in network models using moderation analysis

Jonas M. B. Haslbeck

Summary: Statistical network models like the Gaussian Graphical Model and Ising model are commonly used tools for analyzing multivariate psychological datasets and comparing them across different groups. This paper introduces a new method based on moderation analysis to estimate group differences in network models, allowing comparisons across multiple groups within a single model. The performance of this method is evaluated against existing approaches in a simulation study, and a reproducible tutorial on using the method to compare network models across three groups is provided.

BEHAVIOR RESEARCH METHODS (2022)

Article Psychology, Mathematical

The Beijing Sentence Corpus: A Chinese sentence corpus with eye movement data and predictability norms

Jinger Pan, Ming Yan, Eike M. Richter, Hua Shu, Reinhold Kliegl

Summary: The report introduces the Beijing Sentence Corpus (BSC), a Chinese sentence corpus with predictability norms. Research using this corpus can shed light on predictive processes and theoretical debates on saccade target selection in Chinese reading. Analyses conducted with 60 BSC readers explore the influences of launch word and target word properties on eye movements.

BEHAVIOR RESEARCH METHODS (2022)

Review Psychology, Mathematical

Raising awareness about measurement error in research on unconscious mental processes

Miguel A. Vadillo, Simone Malejka, Daryl Y. H. Lee, Zoltan Dienes, David R. Shanks

Summary: Experimental psychologists often overlook the poor psychometric properties of dependent measures in their studies. The lack of statistically significant correlations can't strongly support the conclusion in research on unconscious cognition. A case study on contextual cuing reveals that it is difficult to draw firm conclusions about the unconscious character of the effect from correlational analyses based on the low reliability of collected measures.

PSYCHONOMIC BULLETIN & REVIEW (2022)

Review Psychology, Mathematical

Peripheral vision in real-world tasks: A systematic review

Christian Vater, Benjamin Wolfe, Ruth Rosenholtz

Summary: Peripheral vision plays a fundamental role in real-world tasks, and applied research has revealed new functions and actions related to peripheral vision. It is important for comparing body/vehicle position with objects and involves tradeoffs in decision-making. Basic, sport, and applied science can benefit from each other's methodologies to enhance our understanding of peripheral vision.

PSYCHONOMIC BULLETIN & REVIEW (2022)

Article Psychology, Mathematical

r2mlm: An R package calculating R-squared measures for multilevel models

Mairead Shaw, Jason D. Rights, Sonya S. Sterba, Jessica Kay Flake

Summary: This article introduces a new R package called r2mlm that automates the computation of R-squared measures for multilevel models and provides visualizations. By using open data and code examples, readers can learn how to use and interpret the output of this R package.

BEHAVIOR RESEARCH METHODS (2023)

Article Psychology, Mathematical

A systematic survey of face stimuli used in psychological research 2000-2020

Amy Dawel, Elizabeth J. Miller, Annabel Horsburgh, Patrice Ford

Summary: Traditional psychology has primarily relied on highly standardized images to study people's responses to faces, but using naturalistic images and spontaneous expressions can provide new insights. Surveys show that while most articles use standardized and nonmoving pictures of faces, there is an increasing trend towards using spontaneous expressions.

BEHAVIOR RESEARCH METHODS (2022)

Article Education & Educational Research

Using Sequence Mining Techniques for Understanding Incorrect Behavioral Patterns on Interactive Tasks

Esther Ulitzsch, Qiwei He, Steffi Pohl

Summary: Interactive tasks designed to elicit real-life problem-solving behavior are increasingly used in educational assessments. Analyzing incorrect behavioral patterns with sequence mining techniques can reveal the reasons for examinee failures. By identifying different subgroups of incorrect behavioral patterns, insights into the skills and effort levels needed for solving problems can be gained.

JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS (2022)