4.5 Article

Individualizing goal-setting interventions using automated writing evaluation to support secondary school students' text revisions

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Education & Educational Research

Integrating goal-setting and automated feedback to improve writing outcomes: a pilot study

Joshua Wilson et al.

Summary: This study presents the results of integrating self-regulation through reflection and goal setting with automated writing evaluation technology. The findings suggest that this innovative and scalable technology-based writing intervention has the potential to improve students' writing outcomes.

INNOVATION IN LANGUAGE LEARNING AND TEACHING (2023)

Article Psychology, Educational

Machine Learning in the educational context: Evidence of prediction accuracy considering essays in English as a foreign language

Jennifer Meyer et al.

Summary: Essay writing is an important skill in language learning, but there is a lack of empirical research on argumentative writing competencies in large-scale assessments. Automated scoring techniques can reduce the cost of rating essays, and our study demonstrates the accuracy and potential of using regression analysis and gradient boosting to predict essay scores. The research analyzed a sample of 2179 essays written by students in Germany and Switzerland, showing satisfactory prediction accuracy compared to expert human raters and a commercial software.

ZEITSCHRIFT FUR PADAGOGISCHE PSYCHOLOGIE (2023)

Review Computer Science, Artificial Intelligence

Automated feedback and writing: a multi-level meta-analysis of effects on students' performance

Johanna Fleckenstein et al.

Summary: Adaptive learning opportunities and individualized, timely feedback are effective support measures for students' writing in educational contexts. Automated writing evaluation (AWE) tools based on AI technology can provide individual feedback. The meta-analysis shows a medium effect of automated feedback on students' writing performance, but the heterogeneity in the data suggests that it is not a consistent form of intervention.

FRONTIERS IN ARTIFICIAL INTELLIGENCE (2023)

Article Psychology, Educational

A Meta-Analysis of Writing Treatments for Students in Grades 6-12

Steve Graham et al.

Summary: There is a concern that many adolescents lack the necessary writing skills for success in school, personal life, and the workplace. It is the responsibility of schools to ensure that students acquire these skills. A meta-analysis found that teaching writing had a positive impact on students' writing and reading abilities. Various writing treatments, such as comprehensive writing programs, strategy instruction, and digital writing tools, improved students' performance.

JOURNAL OF EDUCATIONAL PSYCHOLOGY (2023)

Article Education & Educational Research

Computer-Mediated Corrective Feedback to Improve L2 Writing Skills: A Meta-Analysis

Mohammed Ali Mohsen

Summary: This meta-analysis quantifies the effect of computer-generated written feedback on improving L2 writing skills and examines how moderators mitigate the effectiveness. The results show that computer-mediated corrective feedback has a large overall effect on writing fluency and accuracy. Additionally, the effect size varies between automated writing evaluation technology and non-AWE technology. Furthermore, the proficiency level of learners also influences the effectiveness, with larger effects observed in beginner and intermediate learners.

JOURNAL OF EDUCATIONAL COMPUTING RESEARCH (2022)

Article Psychology, Educational

Optimizing Implementation of Artificial-Intelligence-Based Automated Scoring: An Evidence Centered Design Approach for Designing Assessments for AI-based Scoring

Kadriye Ercikan et al.

Summary: This article provides a review of Artificial intelligence (AI)-based methodologies for scoring in educational assessments and proposes an evidence-centered design framework to optimize the development and implementation of AI-based automated scoring, as well as support the validity of inferences from and uses of scores.

JOURNAL OF EDUCATIONAL MEASUREMENT (2022)

Article Education & Educational Research

The effectiveness of automated writing evaluation in EFL/ESL writing: a three-level meta-analysis

Thuy Thi-Nhu Ngo et al.

Summary: This study conducted a meta-analysis to examine the overall effectiveness of automated writing evaluation (AWE) on EFL/ESL student writing performance. The findings revealed a medium overall between-group effect size and a large overall within-group effect size of AWE on student writing performance. The analysis of moderators showed that AWE is more effective in improving vocabulary usage than grammar. Additionally, Grammarly showed potential as a highly effective tool, while Pigai did not demonstrate such effectiveness. The duration of AWE usage, studying with peers, and student characteristics also influenced the effectiveness of AWE. Overall, AWE is recommended for integration in the writing classroom.

INTERACTIVE LEARNING ENVIRONMENTS (2022)

Article Education & Educational Research

Judgment accuracy of German student texts: Do teacher experience and content knowledge matter?

Jens Moeller et al.

Summary: The central purpose of our study is to analyze whether teacher experience and content knowledge relate to teacher judgments on student report texts. The results show that experienced teachers have stricter and more heterogeneous judgments on student reports compared to teacher students and specially trained experts, but the relative judgment accuracy is higher when teachers major in relevant subjects.

TEACHING AND TEACHER EDUCATION (2022)

Article Education & Educational Research

The persuasive essays for rating, selecting, and understanding argumentative and discourse elements (PERSUADE) corpus 1.0

Scott A. Crossley et al.

Summary: This paper introduces the PERSUADE corpus, a large-scale corpus of writing with annotated discourse elements. The goal of the corpus is to stimulate the development of new, open-source scoring algorithms that can identify discourse elements in argumentative writing. This will open up new possibilities for the development of automatic writing evaluation systems that focus specifically on the semantic and organizational elements of student writing.

ASSESSING WRITING (2022)

Article Education & Educational Research

The Effects of Online Feedback on ESL/EFL Writing: A Meta-Analysis

Xiaoxuan Lv et al.

Summary: This study found that online feedback from teachers/instructors is more effective than peer feedback and automated feedback in improving ESL/EFL writing quality. Additionally, educational levels and task genre have an impact on the effectiveness of online feedback on writing quality.

ASIA-PACIFIC EDUCATION RESEARCHER (2021)

Article Education & Educational Research

Do content revising goals change the revising behavior and story writing of fourth grade students at-risk for writing difficulties?

Steve Graham et al.

Summary: The study found that repeated application of content revising goals resulted in positive and independent changes in students' revising behaviors for fourth grade students at-risk for writing difficulties. While the length and quality of posttest stories for students in the two different revising goal conditions did not differ statistically, the content revising goal condition outperformed in text-level revisions.

READING AND WRITING (2021)

Article Education & Educational Research

Judgment accuracy in experienced versus student teachers: Assessing essays in English as a foreign language

Thorben Jansen et al.

Summary: Teacher judgment accuracy (TJA) is essential for diagnostic competence, but research has shown that experienced teachers tend to be more critical in their assessments compared to student teachers and experts. This difference remains even when content knowledge is controlled for, indicating a potential blind spot among experts.

TEACHING AND TEACHER EDUCATION (2021)

Article Psychology, Multidisciplinary

Is a Long Essay Always a Good Essay? The Effect of Text Length on Writing Assessment

Johanna Fleckenstein et al.

FRONTIERS IN PSYCHOLOGY (2020)

Article Education & Educational Research

The Effects of Writing on Learning in Science, Social Studies, and Mathematics: A Meta-Analysis

Steve Graham et al.

REVIEW OF EDUCATIONAL RESEARCH (2020)

Article Psychology, Educational

From feedback to revisions: Effects of feedback features and perceptions

Yong Wu et al.

CONTEMPORARY EDUCATIONAL PSYCHOLOGY (2020)

Review Psychology, Multidisciplinary

The Power of Feedback Revisited: A Meta-Analysis of Educational Feedback Research

Benedikt Wisniewski et al.

FRONTIERS IN PSYCHOLOGY (2020)

Article Education & Educational Research

Linking TOEFL iBT (R) writing rubrics to CEFR levels: Cut scores and validity evidence from a standard setting study

Johanna Fleckenstein et al.

ASSESSING WRITING (2020)

Article Psychology, Educational

A Meta-Analysis of Negative Feedback on Intrinsic Motivation

Carlton J. Fong et al.

EDUCATIONAL PSYCHOLOGY REVIEW (2019)

Review Education & Educational Research

Systematic review of research on artificial intelligence applications in higher education - where are the educators?

Olaf Zawacki-Richter et al.

INTERNATIONAL JOURNAL OF EDUCATIONAL TECHNOLOGY IN HIGHER EDUCATION (2019)

Article Education & Educational Research

Contrasting Writing Practice Formats in a Writing Strategy Tutoring System

Rod D. Roscoe et al.

JOURNAL OF EDUCATIONAL COMPUTING RESEARCH (2019)

Article Education & Educational Research

Student Use of Automated Essay Evaluation Technology During Revision

Noreen S. Moore et al.

JOURNAL OF WRITING RESEARCH (2016)

Article Psychology, Educational

Do sixth-grade writers need process strategies?

Mark Torrance et al.

BRITISH JOURNAL OF EDUCATIONAL PSYCHOLOGY (2015)

Article Education, Special

A Meta-Analysis of Writing Interventions for Students With Learning Disabilities

Amy Gillespie et al.

EXCEPTIONAL CHILDREN (2014)

Article Psychology, Educational

Children's high-level writing skills: Development of planning and revising and their contribution to writing quality

Teresa Limpo et al.

BRITISH JOURNAL OF EDUCATIONAL PSYCHOLOGY (2014)

Article Psychology, Educational

Writing Pal: Feasibility of an Intelligent Writing Strategy Tutor in the High School Classroom

Rod D. Roscoe et al.

JOURNAL OF EDUCATIONAL PSYCHOLOGY (2013)

Article Communication

Modeling and Remodeling Writing

John R. Hayes

WRITTEN COMMUNICATION (2012)

Article Psychology, Educational

Accuracy of Teachers' Judgments of Students' Academic Achievement: A Meta-Analysis

Anna Suedkamp et al.

JOURNAL OF EDUCATIONAL PSYCHOLOGY (2012)

Article Education & Educational Research

Beyond feedback: developing student capability in complex appraisal

D. Royce Sadler

ASSESSMENT & EVALUATION IN HIGHER EDUCATION (2010)

Article Psychology, Educational

Do Goals Affect the Structure of Students' Argumentative Writing Strategies?

Ralph P. Ferretti et al.

JOURNAL OF EDUCATIONAL PSYCHOLOGY (2009)

Review Psychology, Educational

A meta-analysis of writing instruction for adolescent students

Steve Graham et al.

JOURNAL OF EDUCATIONAL PSYCHOLOGY (2007)

Article Education & Educational Research

Automated writing evaluation: defining the classroom research agenda

Mark Warschauer et al.

LANGUAGE TEACHING RESEARCH (2006)