Article
Psychology, Educational
Gabriel Nagy, Esther Ulitzsch
Summary: The article discusses procedures and IRT models based on response times, proposes a distinction between independent and dependent latent class IRT models, and summarizes and extends existing models. It ultimately introduces a flexible multilevel mixture IRT framework and presents the results.
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT
(2022)
Article
Psychology, Mathematical
David J. Hauser, Aaron J. Moss, Cheskie Rosenzweig, Shalom N. Jaffe, Jonathan Robinson, Leib Litman
Summary: Maintaining data quality has always been a concern on Amazon Mechanical Turk (MTurk). CloudResearch assessed MTurkers and categorized them into high- and low-quality data providers, finding that the high-quality group performed better on various measures.
BEHAVIOR RESEARCH METHODS
(2022)
Review
Psychology, Mathematical
Alon Zivony, Dominique Lamy
Summary: Research has shown that failure to report the second target is primarily due to disrupted attentional engagement, characterized by a smaller and delayed N2pc component. This disruption occurs after early processing of T2, weakens its semantic processing, and prevents its encoding into working memory.
PSYCHONOMIC BULLETIN & REVIEW
(2022)
Article
Psychology, Educational
Ulrich Schroeders, Christoph Schmidt, Timo Gnambs
Summary: This study examines the bias of careless responding in survey responses, which poses a threat to the reliability and validity of psychological measurements. The introduction of gradient boosted trees as a machine learning technique to identify careless respondents outperformed traditional detection mechanisms in simulated studies, but this advantage did not translate to empirical studies. Existing detection methods may not be robust enough to handle the erratic nature of responses in real-world settings, prompting further research in the field.
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT
(2022)
Article
Mathematics, Interdisciplinary Applications
Esther Ulitzsch, Steffi Pohl, Lale Khorramdel, Ulf Kroehne, Matthias von Davier
Summary: Careless and insufficient effort responding (C/IER) poses a threat to data quality and validity of inferences drawn from questionnaire data. A model-based approach is presented to detect various manifestations of C/IER by utilizing response time information and theoretical considerations. The approach considers individual differences in response behavior, allows for variations in attentiveness, and deals with different response patterns arising from C/IER.
Article
Psychology, Mathematical
Nikolaos Flemotomos, Victor R. Martinez, Zhuohao Chen, Karan Singla, Victor Ardulov, Raghuveer Peri, Derek D. Caperton, James Gibson, Michael J. Tanana, Panayiotis Georgiou, Jake Van Epps, Sarah P. Lord, Tad Hirsch, Zac E. Imel, David C. Atkins, Shrikanth Narayanan
Summary: With the prevalence of psychological interventions increasing, it is important to have measures in place to assess the effectiveness of psychological care. Traditional quality assessment methods are costly and time-consuming, leading to poor feasibility in real-world settings. Automated competency rating tools have been developed to provide comprehensive feedback to therapists, improving training and ultimately leading to more positive clinical outcomes.
BEHAVIOR RESEARCH METHODS
(2022)
Article
Mathematics, Interdisciplinary Applications
Gyeongcheol Cho, Marko Sarstedt, Heungsun Hwang
Summary: Structural equation modelling (SEM) has two domains, factor-based and component-based, each with their own population models. Component-based approaches are generally more robust to construct misrepresentation and should be preferred over factor-based approaches for component models. Among component-based approaches, GSCA is recommended over PLSPM regardless of construct misrepresentation.
BRITISH JOURNAL OF MATHEMATICAL & STATISTICAL PSYCHOLOGY
(2022)
Article
Psychology, Mathematical
Xu Xu, Jiayin Li, Huilin Chen
Summary: This study presents valence and arousal ratings for 11,310 simplified Chinese words, validated through comparisons with prior ratings of smaller word samples. The availability of age-of-acquisition and concreteness ratings for a large portion of the words enriches the MELD-SCH database and provides insights into psycholinguistic constructs. Cross-language comparisons suggest cultural and sociopolitical influences on affect representations.
BEHAVIOR RESEARCH METHODS
(2022)
Correction
Mathematics, Interdisciplinary Applications
Sacha Epskamp, Adela-Maria Isvoranu, Mike W. -L. Cheung
Article
Psychology, Mathematical
Alberto Soto-Fernandez, Oleguer Camerino, Xavier Iglesias, M. Teresa Anguera, Marta Castaner
Summary: LINCE PLUS is a free software program designed for systematic observational studies in sports and health, allowing collaborative work and real-time data analysis display.
BEHAVIOR RESEARCH METHODS
(2022)
Article
Education & Educational Research
Francis L. Huang
Summary: This article introduces the generalized estimating equations (GEEs) approach for analyzing clustered data, which is less commonly used in the education field. Through worked examples with continuous and binary outcomes, comparisons are made between GEEs, multilevel models, and ordinary least squares to highlight similarities and differences between the methods. Detailed walkthroughs are provided using both R and SPSS Version 26.
JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS
(2022)
Article
Psychology, Mathematical
Dan R. Johnson, James C. Kaufman, Brendan S. Baker, John D. Patterson, Baptiste Barbot, Adam E. Green, Janet van Hell, Evan Kennedy, Grace F. Sullivan, Christa L. Taylor, Thomas Ward, Roger E. Beaty
Summary: This study integrates creativity theory and distributional semantics theory to develop a new conceptualization of creativity in narratives, called divergent semantic integration (DSI). Through multiple studies and a large number of narratives, six different models of DSI were compared. The results showed that the DSI scores generated by the BERT model had high predictive power, explaining a significant amount of variance in human creativity ratings and approaching human inter-rater reliability for some tasks.
BEHAVIOR RESEARCH METHODS
(2023)
Article
Psychology, Mathematical
Sebastiaan Mathot, Ana Vilotijevic
Summary: Cognitive pupillometry is a method that involves measuring pupil size to investigate cognitive processes. However, there is currently no consensus on the methodology for conducting such experiments, leading to variations in approaches between research groups and even within the same group. This article provides a comprehensive guide to methods in cognitive pupillometry, covering experimental design, preprocessing of data, and statistical techniques. Code and toolboxes are also provided for preprocessing and statistical analysis, along with example experiments and scripts.
BEHAVIOR RESEARCH METHODS
(2023)
Article
Psychology, Mathematical
Jonas M. B. Haslbeck
Summary: Statistical network models like the Gaussian Graphical Model and Ising model are commonly used tools for analyzing multivariate psychological datasets and comparing them across different groups. This paper introduces a new method based on moderation analysis to estimate group differences in network models, allowing comparisons across multiple groups within a single model. The performance of this method is evaluated against existing approaches in a simulation study, and a reproducible tutorial on using the method to compare network models across three groups is provided.
BEHAVIOR RESEARCH METHODS
(2022)
Article
Psychology, Mathematical
Jinger Pan, Ming Yan, Eike M. Richter, Hua Shu, Reinhold Kliegl
Summary: The report introduces the Beijing Sentence Corpus (BSC), a Chinese sentence corpus with predictability norms. Research using this corpus can shed light on predictive processes and theoretical debates on saccade target selection in Chinese reading. Analyses conducted with 60 BSC readers explore the influences of launch word and target word properties on eye movements.
BEHAVIOR RESEARCH METHODS
(2022)
Review
Psychology, Mathematical
Miguel A. Vadillo, Simone Malejka, Daryl Y. H. Lee, Zoltan Dienes, David R. Shanks
Summary: Experimental psychologists often overlook the poor psychometric properties of dependent measures in their studies. The lack of statistically significant correlations can't strongly support the conclusion in research on unconscious cognition. A case study on contextual cuing reveals that it is difficult to draw firm conclusions about the unconscious character of the effect from correlational analyses based on the low reliability of collected measures.
PSYCHONOMIC BULLETIN & REVIEW
(2022)
Review
Psychology, Mathematical
Christian Vater, Benjamin Wolfe, Ruth Rosenholtz
Summary: Peripheral vision plays a fundamental role in real-world tasks, and applied research has revealed new functions and actions related to peripheral vision. It is important for comparing body/vehicle position with objects and involves tradeoffs in decision-making. Basic, sport, and applied science can benefit from each other's methodologies to enhance our understanding of peripheral vision.
PSYCHONOMIC BULLETIN & REVIEW
(2022)
Article
Psychology, Mathematical
Mairead Shaw, Jason D. Rights, Sonya S. Sterba, Jessica Kay Flake
Summary: This article introduces a new R package called r2mlm that automates the computation of R-squared measures for multilevel models and provides visualizations. By using open data and code examples, readers can learn how to use and interpret the output of this R package.
BEHAVIOR RESEARCH METHODS
(2023)
Article
Psychology, Mathematical
Amy Dawel, Elizabeth J. Miller, Annabel Horsburgh, Patrice Ford
Summary: Traditional psychology has primarily relied on highly standardized images to study people's responses to faces, but using naturalistic images and spontaneous expressions can provide new insights. Surveys show that while most articles use standardized and nonmoving pictures of faces, there is an increasing trend towards using spontaneous expressions.
BEHAVIOR RESEARCH METHODS
(2022)
Article
Education & Educational Research
Esther Ulitzsch, Qiwei He, Steffi Pohl
Summary: Interactive tasks designed to elicit real-life problem-solving behavior are increasingly used in educational assessments. Analyzing incorrect behavioral patterns with sequence mining techniques can reveal the reasons for examinee failures. By identifying different subgroups of incorrect behavioral patterns, insights into the skills and effort levels needed for solving problems can be gained.
JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS
(2022)