Psychology, Mathematical

Article Psychology, Educational

Investigating Heterogeneity in Response Strategies: A Mixture Multidimensional IRTree Approach

Oe. Emre C. Alagoez, Thorsten Meiser

Summary: To improve the validity of self-report measures, researchers can use IRTtree models to control for response style effects. Traditional IRTtree models assume that all respondents use the same response style, while a new mixture multidimensional IRTtree model takes into account heterogeneity in response strategies. In an application to empirical data, the new model reveals distinct response strategy classes.

EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT (2023)

Article Education & Educational Research

Bayesian Logistic Regression: A New Method to Calibrate Pretest Items in Multistage Adaptive Testing

Tsunghan Ho

Summary: An operational multistage adaptive test (MST) requires the development of a large item bank and the effort to continuously replenish the item bank due to concerns about test security and validity over the long term. In this study, various calibration/linking methods along with a newly proposed Bayesian logistic regression (BLR) method were evaluated by comparison with the test characteristic curve method through simulated MST response data in terms of item parameter recovery. The findings suggest that the BLR method is promising in terms of estimation stability and robustness across different conditions.

APPLIED MEASUREMENT IN EDUCATION (2023)

Article Education & Educational Research

Combining Human and Automated Scoring Methods in Experimental Assessments of Writing: A Case Study Tutorial

Reagan Mozer, Luke Miratrix, Jackie Eunjung Relyea, James S. Kim

Summary: This article introduces a pipeline for using machine-based text analysis and data mining tools to analyze the impacts of text outcomes, providing a more comprehensive understanding of experimental evaluations. Through a case study in the field of education, it demonstrates how machine learning can enrich impact evaluations by providing a detailed picture of the mechanisms behind stronger argumentative writing.

JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS (2023)

Article Education & Educational Research

Detecting Item Parameter Drift in Small Sample Rasch Equating

Daniel Jurich, Chunyan Liu

Summary: This study investigates methods to detect parameter drift in small sample equating and proposes strategies to improve equating accuracy. The results demonstrate that these methods can mitigate the adverse effects of drifting anchor items under certain conditions.

APPLIED MEASUREMENT IN EDUCATION (2023)

Article Psychology, Mathematical

Gaze coherence reveals distinct tracking strategies in multiple object and multiple identity tracking

Jiri Lukavsky, Hauke S. Meyerhoff

Summary: In dynamic environments, the attentional system is responsible for tracking objects' changing spatial location over time. This study found that there was greater coherence in gaze behavior in repeated multiple object tracking (MOT) trials compared to repeated multiple identity tracking (MIT) trials or mixed MOT-MIT trial pairs. A simulation study also suggested that MOT is based more on a grouping mechanism, while MIT is based more on a target-jumping mechanism. These findings suggest that MOT and MIT may not emerge from the same basic tracking mechanism.

PSYCHONOMIC BULLETIN & REVIEW (2023)

Article Mathematics, Interdisciplinary Applications

Logistic Normal Multinomial Factor Analyzers for Clustering Microbiome Data

Wangshu Tu, Sanjeena Subedi

Summary: The human microbiome has a significant impact on human health and disease. A logistic normal multinomial mixture model (LNM-MM) and logistic normal multinomial factor analyzers (LNM-FA) were proposed for clustering microbiome data in order to identify patterns across samples. The LNM-FA models are particularly suitable for high-dimensional data.

JOURNAL OF CLASSIFICATION (2023)

Article Mathematics, Interdisciplinary Applications

A Latent Hidden Markov Model for Process Data

Xueying Tang

Summary: This paper proposes a statistical model using hidden Markov models to describe response processes and their variations across respondents. By incorporating latent traits, the model provides a parsimonious and interpretable characterization of heterogeneity in response processes.

PSYCHOMETRIKA (2023)

Article Psychology, Mathematical

More powerful parameter tests? No, rather biased parameter estimates. Some reflections on path analysis with weighted composites

Florian Schuberth, Tamara Schamberger, Jorg Henseler

Summary: This article compares the effectiveness of covariance-based structural equation modeling (CB-SEM) and path analysis using weighted composite scores. The authors criticize a previous study and provide new experimental evidence to support their own findings.

BEHAVIOR RESEARCH METHODS (2023)

Article Education & Educational Research

A Two-Level Adaptive Test Battery

Wim J. van der Linden, Luping Niu, Seung W. Choi

Summary: This paper presents a test battery with two different levels of adaptation: a within-subtest level for item selection and a between-subtest level for transitioning. The battery uses a two-level model and an optimized MCMC algorithm to update ability parameters, select items based on Bayesian optimality, and move adaptively between subtests. The algorithm shows rapid convergence and simple posterior calculations, making it suitable for real-world applications without noticeable latency. An empirical study demonstrates that the battery achieves accuracy rates similar to traditional one-level adaptive testing with longer subtests.

JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS (2023)

Article Psychology, Mathematical

Cognitive load enhances patience rather than impulsivity

Tao Jiang, Junyi Dai

Summary: Previous studies on the impact of cognitive load on time preference have conflicting results. This research provides consistent evidence that cognitive load leads to more patient and random intertemporal choices, while reducing time sensitivity.

PSYCHONOMIC BULLETIN & REVIEW (2023)

Article Psychology, Mathematical

A preference to look closer to the eyes is associated with a position-invariant face neural code

Puneeth N. Chakravarthula, Miguel P. Eckstein

Summary: When looking at faces, humans have a consistent preferred fixation location, either below the eyes or between the nose-tip and mouth. These long-term differences in fixation location may be associated with distinct neural representations of faces.

PSYCHONOMIC BULLETIN & REVIEW (2023)

Article Psychology, Mathematical

The Suite for the Assessment of Low-Level cues on Orientation (SALLO): The psychophysics of spatial orientation in virtual reality

Davide Esposito, Alice Bollini, Monica Gori

Summary: Spatial orientation is a complex ability and studying it with virtual reality lacks suitable methodologies. To address this issue, researchers have developed the SALLO tool suite, which simplifies psychophysical experiments and spatial orientation research in virtual reality, accelerating hypothesis testing and facilitating research in the field.

BEHAVIOR RESEARCH METHODS (2023)

Article Mathematics, Interdisciplinary Applications

Adjusted Residuals for Evaluating Conditional Independence in IRT Models for Multistage Adaptive Testing

Peter W. van Rijn, Usama S. Ali, Hyo Jeong Shin, Sean-Hwane Joo

Summary: This study addresses a key assumption in item response theory (IRT) models for multistage adaptive testing (MST) designs and finds that the generalized residuals without adjustments are inappropriate for MST data. The researchers propose an adjusted residuals method suitable for MST designs and discuss the implications and suggestions for statistical inference using this design.

PSYCHOMETRIKA (2023)

Article Psychology, Mathematical

Shared translation in second language activates unrelated words in first language

Yuqi Hao, Yingyi Luo, Kenneth Han-yang Lin-Hong, Ming Yan

Summary: This study explores bilingual coactivation during natural monolingual sentence-reading comprehension, and reveals that the coactivation is modulated by language-learning experiences.

PSYCHONOMIC BULLETIN & REVIEW (2023)

Article Psychology, Mathematical

What you don't know can't hurt you: Retro-cues benefit working memory regardless of prior knowledge in long-term memory

Vanessa M. Loaiza, Hiu Wah Cheung, David T. Goldenhaus-Manning

Summary: Long-term memory impacts working memory overall, without moderating attention. Retro-cues can benefit working memory performance, regardless of the nature of the shape.

PSYCHONOMIC BULLETIN & REVIEW (2023)

Article Psychology, Mathematical

Visual perceptual learning is effective in the illusory far but not in the near space

Antonio Zafarana, Alessandro Farne, Luigi Tame

Summary: Visual shape discrimination is faster for objects close to the body in the peripersonal space (PPS). This advantage also applies to visually perceived depth based on 2D pictorial cues. While multisensory association also displays similar advantages, the influence of PPS on visual perceptual learning is still uncertain.

PSYCHONOMIC BULLETIN & REVIEW (2023)

Article Psychology, Mathematical

Metacognition of curiosity: People underestimate the seductive lure of non-instrumental information

Sunae Kim, Michiko Sakaki, Kou Murayama

Summary: This study examined whether people can accurately predict their own non-instrumental information-seeking behavior and found that people tend to underestimate the motivational lure of curiosity.

PSYCHONOMIC BULLETIN & REVIEW (2023)

Article Psychology, Mathematical

Never miss a beep: Using mobile sensing to investigate (non-)compliance in experience sampling studies

Thomas Reiter, Ramona Schoedel

Summary: This study examines compliance biases in experience sampling studies and identifies predictors for response behavior. It highlights the importance of considering study-related past behavior and physical context variables in research design and addressing missing data in methodological research.

BEHAVIOR RESEARCH METHODS (2023)

Article Education & Educational Research

Analyzing Polytomous Test Data: A Comparison Between an Information-Based IRT Model and the Generalized Partial Credit Model

Joakim Wallmark, James O. Ramsay, Juan Li, Marie Wiberg

Summary: Item response theory (IRT) models the relationship between test item scores and a test taker's latent trait. This study compares two models for tests with polytomously scored items: the optimal scoring (OS) model and the generalized partial credit (GPC) model. The OS model demonstrates superior fit compared to the GPC model in real data examples, but has larger standard errors in simulation studies. The study also explores the use of surprisal arc length, a scale invariant measure of ability, and illustrates its potential as an alternative to sum scores.

JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS (2023)

Article Education & Educational Research

Change in Engagement During Test Events: An Argument for Weighted Scoring?

Steven L. Wise, G. Gage Kingsbury, Meredith L. Langi

Summary: Recent research suggests that changes in performance during a student's test can indicate their level of test-taking engagement. Meaningful changes in performance indicate that certain parts of the test better reflect the student's maximum ability, while lower-performing portions are less likely to do so. This study found that using weighted scoring, with different weights representing declining or increasing performance, can significantly reduce score distortion caused by disengagement and improve the validity of test scores.

APPLIED MEASUREMENT IN EDUCATION (2023)