4.2 Article

Measurements of performance gaps are sensitive to the level of test stakes: Evidence from PISA and a Field Experiment

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Sociology

From asking to observing. Behavioural measures of socio-emotional and motivational skills in large-scale assessments

F. Borgonovi et al.

Summary: Socio-emotional and motivational skills are commonly measured using self-reports in educational assessments. However, some studies have started to use behavioral measures as alternatives to self-reports. This study calculates behavioral measures of socio-emotional and motivational skills using data from PISA and finds that they capture important aspects of students' academic profiles. However, these measures have limited correlations with each other and with self-report measures, suggesting that they represent different behavioral responses to the test-taking situation.

SOCIAL SCIENCE RESEARCH (2023)

Article Economics

The role of student effort on performance in PISA: revisiting the gender gap in achievement

Lina M. Anaya et al.

Summary: International assessments are crucial for comparing education quality worldwide, yet disregarding students' efforts in low-stakes tests can result in biased interpretations of test performance. By utilizing data from the PISA, we investigate the potential role of student effort in explaining gender achievement gaps across countries. Two effort measures, based on students' response times and post-test survey, highlight a strong association between student efforts and test scores. Accounting for effort differences, the estimated gender achievement gaps in mathematics and science could be significantly wider, favoring boys by up to 36% and 40% of a standard deviation, respectively. Overall, our effort measures explain an average of 51% to 56% of the cross-country variation in test scores.

OXFORD ECONOMIC PAPERS-NEW SERIES (2023)

Article Psychology, Educational

Model-Based Treatment of Rapid Guessing

Tobias Deribo et al.

Summary: The study found that lower-ability test-takers tend to rapidly guess more frequently and are more likely to be unable to solve an item they guessed on, indicating a violation of the assumption of ignorable missing data underlying response-level filtering. Different approaches to treating response-level filtered responses can significantly impact ability estimation results.

JOURNAL OF EDUCATIONAL MEASUREMENT (2021)

Review Psychology

Testing (Quizzing) Boosts Classroom Learning: A Systematic an Meta-Analytic Review

Chunliang Yang et al.

Summary: Studies have shown that testing is an effective intervention for enhancing long-term retention of knowledge. In classroom settings, factors such as learning strategy, test format, and material matching can influence the testing effect.

PSYCHOLOGICAL BULLETIN (2021)

Article Psychology, Developmental

Performance decline in a low-stakes test at age 15 and educational attainment at age 25: Cross-country longitudinal evidence

F. Borgonovi et al.

Summary: The study demonstrates a positive relationship between effort level and performance decline, which significantly impacts the attainment of higher education qualifications. Gender, socio-economic status, and baseline ability do not show significant differences in this relationship. Self-reported measures of achievement motivation do not predict educational attainment in the three countries.

JOURNAL OF ADOLESCENCE (2021)

Article Psychology, Clinical

On the Treatment of Missing Item Responses in Educational Large-Scale Assessment Data: An Illustrative Simulation Study and a Case Study Using PISA 2018 Mathematics Data

Alexander Robitzsch

Summary: The phenomenon of missing item responses is prevalent in educational large-scale assessment studies, with operational practice scoring them as wrong or using model-based or imputation-based treatments. The Mislevy-Wu model provides unbiased model parameters and is preferred over the latent ignorable model for better model fit and fairness in country comparisons.

EUROPEAN JOURNAL OF INVESTIGATION IN HEALTH PSYCHOLOGY AND EDUCATION (2021)

Article Psychology, Developmental

Performance decline in a low-stakes test at age 15 and educational attainment at age 25: Cross-country longitudinal evidence

F. Borgonovi et al.

Summary: This study provides longitudinal evidence using behavioral measures of motivation and engagement from PISA follow-ups in Australia, Denmark, and Switzerland. The performance decline in cognitive tasks at age of 15 is associated with educational attainment at the age of 25, with no differences by gender, SES, and baseline achievement levels.

JOURNAL OF ADOLESCENCE (2021)

Article Mathematics, Interdisciplinary Applications

A hierarchical latent response model for inferences about examinee engagement in terms of guessing and item-level non-response

Esther Ulitzsch et al.

BRITISH JOURNAL OF MATHEMATICAL & STATISTICAL PSYCHOLOGY (2020)

Article Psychology, Educational

Using Process Data to Explain Group Differences in Complex Problem Solving

Beate Eichmann et al.

JOURNAL OF EDUCATIONAL PSYCHOLOGY (2020)

Article Social Sciences, Interdisciplinary

The (Non)Impact of Differential Test Taker Engagement on Aggregated Scores

Steven L. Wise et al.

INTERNATIONAL JOURNAL OF TESTING (2020)

Article Multidisciplinary Sciences

Females show more sustained performance during test-taking than males

Pau Balart et al.

NATURE COMMUNICATIONS (2019)

Article Education & Educational Research

The Achievement Gap or the Engagement Gap?Investigating the Sensitivity of Gaps Estimates to Test Motivation

James Soland

APPLIED MEASUREMENT IN EDUCATION (2018)

Review Psychology, Multidisciplinary

The Testing Effect in the Psychology Classroom: A Meta-Analytic Perspective

Juliane Schwieren et al.

PSYCHOLOGY LEARNING AND TEACHING-PLAT (2017)

Article Education & Educational Research

Rapid-Guessing Behavior: Its Identification, Interpretation, and Implications

Steven L. Wise

EDUCATIONAL MEASUREMENT-ISSUES AND PRACTICE (2017)

Article Multidisciplinary Sciences

What grades and achievement tests measure

Lex Borghans et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2016)

Article Economics

GENDER DIFFERENCES IN RESPONSE TO BIG STAKES

Ghazala Azmat et al.

JOURNAL OF THE EUROPEAN ECONOMIC ASSOCIATION (2016)

Article Psychology, Educational

An international comparison of students' ability to endure fatigue and maintain motivation during a low-stakes test

Francesca Borgonovi et al.

LEARNING AND INDIVIDUAL DIFFERENCES (2016)

Article Economics

Immigrant student performance in Math: Does it matter where you come from?

Gianna Claudia Giannelli et al.

ECONOMICS OF EDUCATION REVIEW (2016)

Article Economics

Dynamics of the black-white gap in academic achievement

Ian K. McDonough

ECONOMICS OF EDUCATION REVIEW (2015)

Review Economics

The Role of Cognitive Skills in Economic Development

Eric A. Hanushek et al.

JOURNAL OF ECONOMIC LITERATURE (2008)

Article Economics

The role of noncognitive skills in explaining cognitive test scores

Lex Borghans et al.

ECONOMIC INQUIRY (2008)

Article Psychology, Multidisciplinary

Test-enhanced learning - Taking memory tests improves long-term retention

HL Roediger et al.

PSYCHOLOGICAL SCIENCE (2006)

Article Education & Educational Research

Response time effort: A new measure of examinee motivation in computer-based tests

SL Wise et al.

APPLIED MEASUREMENT IN EDUCATION (2005)

Article Education & Educational Research

Low Examinee Effort in Low-Stakes Assessment: Problems and Potential Solutions

Steven L. Wise et al.

EDUCATIONAL ASSESSMENT (2005)