4.0 Article

Change in Engagement During Test Events: An Argument for Weighted Scoring?

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Education & Educational Research

The role of rapid guessing and test-taking persistence in modelling test-taking engagement

Gabriel Nagy et al.

Summary: This study aims to improve the identification of disengaged responses by considering indicators such as item solution probabilities and performance declines. The results indicate that response times alone cannot fully explain response disengagement, as item responses still reflect test-taking persistence even when rapid responses are accounted for. Furthermore, the item response theory models for test-taking persistence can effectively account for the impact of low test-taking effort even without response times.

JOURNAL OF COMPUTER ASSISTED LEARNING (2023)

Article Education & Educational Research

Performance Decline as an Indicator of Generalized Test-Taking Disengagement

Steven Wise et al.

Summary: This study describes a method for identifying significant performance decline during a test and investigates its usefulness as an indicator of generalized test-taking disengagement. The analysis shows that performance decline classifications have similar characteristics to disengagement classifications based on rapid guessing, and it can identify disengagement in students who may not be identified based on rapid-guessing behavior.

APPLIED MEASUREMENT IN EDUCATION (2022)

Article Education & Educational Research

A Method for Identifying Partial Test-Taking Engagement

Steven Wise et al.

Summary: Effort-moderated (E-M) scoring is designed to estimate the performance of fully engaged test takers, but recent research suggests that responses used in E-M scoring may sometimes reflect partial engagement, reducing the trustworthiness of the scores. Therefore, caution should be exercised when interpreting effort-moderated scores if partial engagement is detected during test events.

APPLIED MEASUREMENT IN EDUCATION (2021)

Article Psychology, Educational

Using Retest Data to Evaluate and Improve Effort-Moderated Scoring

Steven L. Wise et al.

Summary: Research has shown that effort-moderated scoring methods can partially account for score distortion caused by test disengagement. A modified scoring method performed better, but was still unable to fully explain the score distortion.

JOURNAL OF EDUCATIONAL MEASUREMENT (2021)

Article Education & Educational Research

Change in Self-Reported Motivation before to after Test Completion: Relation with Performance

Aaron J. Myers et al.

Summary: Perceived test importance and effort levels may differ when measured before and after a test, with retrospective scores potentially providing more accurate reflections. Individual differences in change in effort levels were not predicted by test performance, indicating that the timing of effort measurement relative to test completion could impact conclusions drawn.

JOURNAL OF EXPERIMENTAL EDUCATION (2021)

Article Education & Educational Research

Six insights regarding test-taking disengagement

Steven L. Wise

Summary: Research has shown that disengaged test taking can have a significant impact on the validity of international assessment programmes, and it is important to address this issue in order to ensure accurate results.

EDUCATIONAL RESEARCH AND EVALUATION (2020)

Article Social Sciences, Interdisciplinary

Examining the simultaneous change in emotions during a test: relations with expended effort and test performance

Sara J. Finney et al.

INTERNATIONAL JOURNAL OF TESTING (2020)

Article Education & Educational Research

Standardization and UNDERSTANDardization in Educational Assessment

Stephen G. Sireci

EDUCATIONAL MEASUREMENT-ISSUES AND PRACTICE (2020)

Article Education & Educational Research

Patterns of Solution Behavior across Items in Low-Stakes Assessments

Dena A. Pastor et al.

EDUCATIONAL ASSESSMENT (2019)

Article Psychology, Multidisciplinary

The Onset of Rapid-Guessing Behavior Over the Course of Testing Time: A Matter of Motivation and Cognitive Resources

Marlit Annalena Lindner et al.

FRONTIERS IN PSYCHOLOGY (2019)

Article Psychology, Educational

The need for self-control in achievement tests: Changes in students' state self-control capacity and effort investment

Christoph Lindner et al.

SOCIAL PSYCHOLOGY OF EDUCATION (2018)

Article Education & Educational Research

Rapid-Guessing Behavior: Its Identification, Interpretation, and Implications

Steven L. Wise

EDUCATIONAL MEASUREMENT-ISSUES AND PRACTICE (2017)

Article Social Sciences, Mathematical Methods

Item Position Effects Are Moderated by Changes in Test-Taking Effort

Sebastian Weirich et al.

APPLIED PSYCHOLOGICAL MEASUREMENT (2017)

Article Education & Educational Research

Change in test-taking motivation and its relationship to test performance in low-stakes assessments

Christiane Penk et al.

EDUCATIONAL ASSESSMENT EVALUATION AND ACCOUNTABILITY (2017)

Article Psychology, Educational

An international comparison of students' ability to endure fatigue and maintain motivation during a low-stakes test

Francesca Borgonovi et al.

LEARNING AND INDIVIDUAL DIFFERENCES (2016)

Article Education & Educational Research

Using response time to investigate students' test-taking behaviors in a NAEP computer-based study

Yi-Hsuan Lee et al.

LARGE-SCALE ASSESSMENTS IN EDUCATION (2014)

Review Psychology, Educational

Validating the Interpretations and Uses of Test Scores

Michael T. Kane

JOURNAL OF EDUCATIONAL MEASUREMENT (2013)

Article Psychology, Educational

Modeling Item-Position Effects Within an IRT Framework

Dries Debeer et al.

JOURNAL OF EDUCATIONAL MEASUREMENT (2013)

Article Education & Educational Research

Skill and will: test-taking motivation and assessment quality

Hanna Eklof

ASSESSMENT IN EDUCATION-PRINCIPLES POLICY & PRACTICE (2010)

Article Education & Educational Research

Correlates of Rapid-Guessing Behavior in Low-Stakes Testing: Implications for Test Development and Measurement Practice

Steven L. Wise et al.

APPLIED MEASUREMENT IN EDUCATION (2009)

Article Psychology, Multidisciplinary

The strength model of self-control

Roy F. Baumeister et al.

CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE (2007)

Article Psychology, Educational

Emotional experiences during test taking: Does cognitive ability make a difference?

Thomas Goetz et al.

LEARNING AND INDIVIDUAL DIFFERENCES (2007)

Article Psychology, Educational

An application of item response time: The effort-moderated IRT model

SL Wise et al.

JOURNAL OF EDUCATIONAL MEASUREMENT (2006)

Article Education & Educational Research

Response time effort: A new measure of examinee motivation in computer-based tests

SL Wise et al.

APPLIED MEASUREMENT IN EDUCATION (2005)

Article Psychology, Multidisciplinary

Diagnosing item score patterns on a test using item response theory-based person-fit statistics

RR Meijer

PSYCHOLOGICAL METHODS (2003)