4.5 Article

A Meta-Analysis of Machine Learning-Based Science Assessments: Factors Impacting Machine-Human Score Agreements

Related references

Note: Only part of the references are listed.
Article Education & Educational Research

On the Validity of Machine Learning-based Next Generation Science Assessments: A Validity Inferential Network

Xiaoming Zhai et al.

Summary: This study examines the impact of machine learning on science assessments and identifies seven critical validity issues of ML-based NGSAs. A validity inferential network is proposed to address these validity issues and ensure accountable assessment design and valid interpretation and use of machine scores.

JOURNAL OF SCIENCE EDUCATION AND TECHNOLOGY (2021)

Article Education & Educational Research

Discrimination of the Contextual Features of Top Performers in Scientific Literacy Using a Machine Learning Approach

Jiangping Chen et al.

Summary: This study identified the most predictive contextual characteristics of top performers in scientific literacy, including the quality of teachers' instructional practices, parents' educational/occupational status, disciplinary climate, among others. These features may provide important information for future studies on students' performance in science literacy.

RESEARCH IN SCIENCE EDUCATION (2021)

Article Computer Science, Interdisciplinary Applications

The effect of automated feedback on revision behavior and learning gains in formative assessment of scientific argument writing

Mengxiao Zhu et al.

COMPUTERS & EDUCATION (2020)

Article Education & Educational Research

Evaluation of construct-irrelevant variance yielded by machine and human scoring of a science teacher PCK constructed response assessment

Xiaoming Zhai et al.

STUDIES IN EDUCATIONAL EVALUATION (2020)

Article Education & Educational Research

From substitution to redefinition: A framework of machine learning-based science assessment

Xiaoming Zhai et al.

JOURNAL OF RESEARCH IN SCIENCE TEACHING (2020)

Article Education & Educational Research

The effectiveness of machine score-ability ratings in predicting automated scoring performance

Susan Lottridge et al.

APPLIED MEASUREMENT IN EDUCATION (2018)

Article Education & Educational Research

Designing educational systems to support enactment of the Next Generation Science Standards

Charles W. Anderson et al.

JOURNAL OF RESEARCH IN SCIENCE TEACHING (2018)

Article Education & Educational Research

Validation of Automated Scoring for a Formative Assessment that Employs Scientific Argumentation

Liyang Mao et al.

EDUCATIONAL ASSESSMENT (2018)

Article Computer Science, Interdisciplinary Applications

Designing Automated Guidance to Promote Productive Revision of Science Explanations

Charissa Tansomboon et al.

INTERNATIONAL JOURNAL OF ARTIFICIAL INTELLIGENCE IN EDUCATION (2017)

Article Computer Science, Interdisciplinary Applications

Different Approaches to Assessing the Quality of Explanations Following a Multiple-Document Inquiry Activity in Science

Jennifer Wiley et al.

INTERNATIONAL JOURNAL OF ARTIFICIAL INTELLIGENCE IN EDUCATION (2017)

Article Computer Science, Interdisciplinary Applications

Reflective Writing About the Utility Value of Science as a Tool for Increasing STEM Motivation and Retention - Can AI Help Scale Up?

Beata Beigman Klebanov et al.

INTERNATIONAL JOURNAL OF ARTIFICIAL INTELLIGENCE IN EDUCATION (2017)

Article Education & Educational Research

Investigating the impact of automated feedback on students' scientific argumentation

Mengxiao Zhu et al.

INTERNATIONAL JOURNAL OF SCIENCE EDUCATION (2017)

Article Education & Educational Research

Assessing the attention levels of students by using a novel attention aware system based on brainwave signals

Chih-Ming Chen et al.

BRITISH JOURNAL OF EDUCATIONAL TECHNOLOGY (2017)

Article Psychology, Educational

Automatic Coding of Short Text Responses via Clustering in Educational Assessment

Fabian Zehner et al.

EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT (2016)

Article Education & Educational Research

The Impact of Misspelled Words on Automated Computer Scoring: A Case Study of Scientific Explanations

Minsu Ha et al.

JOURNAL OF SCIENCE EDUCATION AND TECHNOLOGY (2016)

Article Multidisciplinary Sciences

Can we open the black box of AI?

Davide Castelvecchi

NATURE (2016)

Article Education & Educational Research

Automated analysis of short responses in an interactive synthetic tutoring system for introductory physics

Christopher M. Nakamura et al.

PHYSICAL REVIEW PHYSICS EDUCATION RESEARCH (2016)

Article Psychology, Multidisciplinary

Neural Representations of Physics Concepts

Robert A. Mason et al.

PSYCHOLOGICAL SCIENCE (2016)

Article Rehabilitation

A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research

Terry K. Koo et al.

JOURNAL OF CHIROPRACTIC MEDICINE (2016)

Article Psychology, Educational

Automated Guidance for Student Inquiry

Libby F. Gerard et al.

JOURNAL OF EDUCATIONAL PSYCHOLOGY (2016)

Article Education & Educational Research

Validation of automated scoring of science assessments

Ou Lydia Liu et al.

JOURNAL OF RESEARCH IN SCIENCE TEACHING (2016)

Article Education & Educational Research

Using Automated Scores of Student Essays to Support Teacher Guidance in Classroom Inquiry

Libby F. Gerard et al.

JOURNAL OF SCIENCE TEACHER EDUCATION (2016)

Review Education & Educational Research

Authenticity in Virtual Reality for assessment and intervention in autism: A conceptual review

Sarah Parsons

EDUCATIONAL RESEARCH REVIEW (2016)

Article Education & Educational Research

Designing automated guidance for concept diagrams in inquiry instruction

Kihyun Ryoo et al.

JOURNAL OF RESEARCH IN SCIENCE TEACHING (2016)

Proceedings Paper Computer Science, Interdisciplinary Applications

Using Electroencephalogram to Track Learner's Reasoning in Serious Games

Ramla Ghali et al.

INTELLIGENT TUTORING SYSTEMS, ITS 2016 (2016)

Article Education & Educational Research

Automated Guidance for Thermodynamics Essays: Critiquing Versus Revisiting

Dermot F. Donnelly et al.

JOURNAL OF SCIENCE EDUCATION AND TECHNOLOGY (2015)

Review Multidisciplinary Sciences

Machine learning: Trends, perspectives, and prospects

M. I. Jordan et al.

SCIENCE (2015)

Article Education & Educational Research

Contrasting State-of-the-Art in the Machine Scoring of Short-Form Constructed Responses

Mark D. Shermis

EDUCATIONAL ASSESSMENT (2015)

Article Education & Educational Research

Taking advantage of automated assessment of student-constructed graphs in science

Jonathan M. Vitale et al.

JOURNAL OF RESEARCH IN SCIENCE TEACHING (2015)

Review Education & Educational Research

Automated, adaptive guidance for K-12 education

Libby Gerard et al.

EDUCATIONAL RESEARCH REVIEW (2015)

Article Education & Educational Research

Operationalizing and Detecting Disengagement Within Online Science Microworlds

Janice D. Gobert et al.

EDUCATIONAL PSYCHOLOGIST (2015)

Article Education & Educational Research

Assessing Scientific Practices Using Machine-Learning Methods: How Closely Do They Match Clinical Interview Performance?

Elizabeth P. Beggrow et al.

JOURNAL OF SCIENCE EDUCATION AND TECHNOLOGY (2014)

Article Computer Science, Interdisciplinary Applications

Can Online Discussion Participation Predict Group Project Performance? Investigating the Roles of Linguistic Features and Participation Patterns

Jaebong Yoo et al.

INTERNATIONAL JOURNAL OF ARTIFICIAL INTELLIGENCE IN EDUCATION (2014)

Article Education & Educational Research

Automated Scoring of Constructed-Response Science Items: Prospects and Obstacles

Ou Lydia Liu et al.

EDUCATIONAL MEASUREMENT-ISSUES AND PRACTICE (2014)

Article Education & Educational Research

From Log Files to Assessment Metrics: Measuring Students' Science Inquiry Skills Using Educational Data Mining

Janice D. Gobert et al.

JOURNAL OF THE LEARNING SCIENCES (2013)

Article Education & Educational Research

Transforming Biology Assessment with Machine Learning: Automated Scoring of Written Evolutionary Explanations

Ross H. Nehm et al.

JOURNAL OF SCIENCE EDUCATION AND TECHNOLOGY (2012)

Article Education & Educational Research

Human vs. Computer Diagnosis of Students' Natural Selection Knowledge: Testing the Efficacy of Text Analytic Software

Ross H. Nehm et al.

JOURNAL OF SCIENCE EDUCATION AND TECHNOLOGY (2012)

Review Education & Educational Research

Cognitive Foundations for Science Assessment Design: Knowing What Students Know About Evolution

John E. Opfer et al.

JOURNAL OF RESEARCH IN SCIENCE TEACHING (2012)

Article Education & Educational Research

Comparison of Human and Machine Scoring of Essays: Differences by Gender, Ethnicity, and Country

Brent Bridgeman et al.

APPLIED MEASUREMENT IN EDUCATION (2012)

Article Computer Science, Interdisciplinary Applications

Performance evaluation of an online argumentation learning assistance agent

Chenn-Jung Huang et al.

COMPUTERS & EDUCATION (2011)

Article Computer Science, Cybernetics

An analysis of students' gaming behaviors in an intelligent tutoring system: predictors and impacts

Kasia Muldner et al.

USER MODELING AND USER-ADAPTED INTERACTION (2011)

Article Mathematical & Computational Biology

Fixed effects and variance components estimation in three-level meta-analysis

Spyros Konstantopoulos

RESEARCH SYNTHESIS METHODS (2011)

Article Health Care Sciences & Services

Meta-analysis of Cohen's kappa

Shuyan Sun

HEALTH SERVICES AND OUTCOMES RESEARCH METHODOLOGY (2011)

Article Education & Educational Research

How is Science Learning Assessed at the Postsecondary Level? Assessment and Grading Practices in College Biology, Chemistry and Physics

Karleen Goubeaud

JOURNAL OF SCIENCE EDUCATION AND TECHNOLOGY (2010)

Article Computer Science, Interdisciplinary Applications

Conducting Meta-Analyses in R with the metafor Package

Wolfgang Viechtbauer

JOURNAL OF STATISTICAL SOFTWARE (2010)

Article Computer Science, Interdisciplinary Applications

Assessing creative problem-solving with automated text grading

Hao-Chuan Wang et al.

COMPUTERS & EDUCATION (2008)

Review Education & Educational Research

The effects of modified school calendars on student achievement and on school and community attitudes

H Cooper et al.

REVIEW OF EDUCATIONAL RESEARCH (2003)