4.7 Article

Trends in automated writing evaluation systems research for teaching, learning, and assessment: A bibliometric analysis

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Education & Educational Research

Using automated written corrective feedback in the writing classrooms: effects on L2 writing accuracy

Jessie S. Barrot

Summary: This study examines the impact of Grammarly on college students' overall writing accuracy and errors with different severity levels, and demonstrates the potential of automated written corrective feedback in improving students' writing accuracy. The study also highlights some challenges in the use of automated feedback.

COMPUTER ASSISTED LANGUAGE LEARNING (2023)

Review Agricultural Economics & Policy

Inter-organizational relationships in agri-food sector: a bibliometric review and future directions

Walter Vesperi et al.

Summary: This study provides an academic overview of knowledge transfer in scientific institutions and agri-food organizations, emphasizing the importance of knowledge resources for inter-organizational relationship management in the agri-food sector.

BRITISH FOOD JOURNAL (2023)

Article Education & Educational Research

AI-assisted automated scoring of picture-cued writing tasks for language assessment

Ruibin Zhao et al.

Summary: This paper proposes a novel method for automatically scoring student responses to picture-cued writing tasks. By incorporating cross-modal matching technology and NLP algorithms, an accurate AI scoring model is developed. This method reduces the subjective elements in human grading, saves teachers' time, and promotes more valuable teaching tasks.

EDUCATION AND INFORMATION TECHNOLOGIES (2023)

Article Education & Educational Research

The impact of automated writing evaluation (AWE) on EFL learners' peer and self-editing

Fatima Abdullah Yahya Al-Inbari et al.

Summary: Automated Writing Evaluation (AWE) is a machine technique used for assessing learners' writing. This study compares the effects of automated peer and self-editing using AWE software, WRITER, on Arab EFL learners' cause-effect essay writing. The results indicate that both the peer and self-editing experimental groups benefited from the AWE software, with no significant difference between them. The qualitative data also reflect participants' positive evaluation of the software and the automated editing experience.

EDUCATION AND INFORMATION TECHNOLOGIES (2023)

Review Education & Educational Research

A systematic review of automated writing evaluation systems

Shi Huawei et al.

Summary: Automated writing evaluation (AWE) systems are developed based on interdisciplinary research and technological advances. However, the validity of these systems is questionable. A systematic review of AWE research found a rising trend but heterogeneity in language environments, ecological settings, and educational levels. Most studies adopted quantitative methods and yielded positive results, but research on domain description was lacking.

EDUCATION AND INFORMATION TECHNOLOGIES (2023)

Review Education & Educational Research

Effectiveness of automated writing evaluation systems in school settings: A systematic review of studies from 2000 to 2020

Andreia Nunes et al.

Summary: A systematic review on the effects of Automated Writing Evaluation (AWE) systems in school settings found that these systems generally have a positive impact on writing learning and instruction. They are particularly effective when integrated into comprehensive instructional programs providing ample writing opportunities.

JOURNAL OF COMPUTER ASSISTED LEARNING (2022)

Review Education & Educational Research

A review of AWE feedback: types, learning outcomes, and implications

Qing-Ke Fu et al.

Summary: This review provides a comprehensive analysis of the literature on automated writing evaluation (AWE) feedback for writing, including methodology, types of learners, types of feedback and its applications, learning outcomes, and implications. The findings reveal that most previous studies used quantitative research methods, but there are limitations such as shorter duration and smaller group sizes. The focus of most articles was on L2 writers with less attention paid to L1 writers and K12 students. AWE feedback to some extent can improve students' writing, but is not as effective as human feedback.

COMPUTER ASSISTED LANGUAGE LEARNING (2022)

Review Education & Educational Research

Rebooting assessment. Exploring the challenges and benefits of shifting from pen-and-paper to computer in summative assessment

Katrina Perry et al.

Summary: This systematic review evaluates the implications of increased use of computer-based summative assessments and identifies six key themes. It highlights the importance of this review for teachers and students affected by computer-based assessments, and provides a summary of the existing literature in this rapidly changing field for researchers.

EDUCATIONAL RESEARCH REVIEW (2022)

Review Linguistics

Integrating Technology into ESL/EFL Writing through Grammarly

Jessie Saraza Barrot

Summary: This article introduces a digital tool, Grammarly, which provides computer-mediated corrective feedback on grammar and vocabulary in students' writing, and discusses its applications in ESL and EFL writing. While Grammarly is a powerful tool, it needs further enhancements.

RELC JOURNAL (2022)

Article Education & Educational Research

Appropriating automated feedback in L2 writing: experiences of Chinese EFL student writers

Lianjiang Jiang et al.

Summary: This study explores how students utilize automated feedback in their writing activities. The findings reveal three forms of appropriation and show that students use various artifacts, rules, and community members to mediate their appropriation. The study also highlights the differences in students' internalization processes. This research emphasizes the importance of developing students' awareness of mediating resources and internationalization strategies for self-regulated use of automated feedback.

COMPUTER ASSISTED LANGUAGE LEARNING (2022)

Article Education & Educational Research

Impact of automated writing evaluation on teacher feedback, student revision, and writing improvement

Stephanie Link et al.

Summary: In recent years, there has been growing interest in the use of automated writing evaluation (AWE) in second language writing classrooms. However, little evidence has supported the claims of its effectiveness. This study compared two groups of second language writing classes, one with AWE and teacher feedback, and the other with only teacher feedback. The results showed that AWE did not significantly impact the amount of feedback provided by teachers, but teachers without AWE tended to provide more lower-level feedback. Interestingly, students seemed to revise the teacher's feedback more frequently than computer-generated feedback and retained their improvement in accuracy in the long-term when they had access to AWE. This study contributes to the discussion on how AWE can best support second language writing development.

COMPUTER ASSISTED LANGUAGE LEARNING (2022)

Article Education & Educational Research

Teachers in automated writing evaluation (AWE) system-supported ESL writing classes: Perception, implementation, and influence

Zhi Li

Summary: This study investigated three ESL teachers' perceptions and uses of the AWE system Criterion(R), revealing that teachers took different approaches to integrating AWE systems in the classroom, leading to observable differences in students' writing performance. The findings suggest that teacher agency and cognition play a significant role in influencing students' writing development in technology-supported ESL classrooms.

SYSTEM (2021)

Article Linguistics

L2 student engagement with automated feedback on writing: Potential for learning and issues of trust

Jim Ranalli

Summary: The study found that participants tended to view AWE feedback as a proofreading rather than a learning opportunity, possibly because the feedback included specific corrections that required less effort on the part of the user.

JOURNAL OF SECOND LANGUAGE WRITING (2021)

Review Computer Science, Interdisciplinary Applications

A review of automated feedback systems for learners: Classification framework, challenges and opportunities

Galina Deeva et al.

Summary: Real-time teacher feedback is crucial for learners' knowledge and skills acquisition. Recent technological advancements have enabled the development of computer tutoring systems that provide personalized feedback, supporting learners in various domains and settings.

COMPUTERS & EDUCATION (2021)

Article Computer Science, Interdisciplinary Applications

Dispersion measures for h-index: a study of the Brazilian researchers in the field of mathematics

Deise Deolindo Silva et al.

Summary: This study analyzed Brazilian mathematicians and found that the dci and dco indices can more accurately measure the scientific performance of researchers, help distinguish productive researchers, and estimate the likelihood of increasing the h-index.

SCIENTOMETRICS (2021)

Article Psychology, Multidisciplinary

How Technology Tools Impact Writing Performance, Lexical Complexity, and Perceived Self-Regulated Learning Strategies in EFL Academic Writing: A Comparative Study

Yangxi Han et al.

Summary: The study found that technology mediation significantly supported the development of students' self-regulated learning strategies, particularly in enhancing academic writing performance, but did not significantly improve students' lexical complexity. The use of learning management systems and automated writing evaluation platforms can assist students' self-regulated learning to enhance their writing performance.

FRONTIERS IN PSYCHOLOGY (2021)

Article Psychology, Multidisciplinary

Exploring Learner Engagement With Multiple Sources of Feedback on L2 Writing Across Genres

Yali Shi

Summary: This study examined how second-year English majors engaged with automated, peer, and teacher feedback across three genres in an L2 writing class, finding that students' engagement with feedback varied by source and genre, with teacher feedback being the most highly incorporated.

FRONTIERS IN PSYCHOLOGY (2021)

Article Computer Science, Interdisciplinary Applications

Elementary teachers' perceptions of automated feedback and automated scoring: Transforming the teaching and learning of writing using automated writing evaluation

Joshua Wilson et al.

Summary: The study revealed that the automated writing evaluation system has complex effects on teachers and students, both assisting and challenging teachers in their instructional practices. Additionally, AWE influences students' writing motivation and independence in complex ways, potentially creating new instructional challenges.

COMPUTERS & EDUCATION (2021)

Article Education & Educational Research

Voluntary use of automated writing evaluation by content course students

Aysel Saricaoglu et al.

Summary: Automated writing evaluation technologies, known as AWE, are widely used to help students enhance their language accuracy through automated feedback. This study examines the voluntary use of Criterion by English as a foreign language students in two content courses for two assignments. The findings indicate that while not all students utilized Criterion, engagement with automated feedback significantly reduced errors in 11 categories across the two assignments from the first draft to the last.

RECALL (2021)

Article Education & Educational Research

Perspectives on Using Automated Writing Evaluation Systems to Provide Written Corrective Feedback in the ESL Classroom

Johanathan Woodworth et al.

TESL CANADA JOURNAL (2020)

Article Information Science & Library Science

Library-Faculty Referencing and Plagiarism Pilot Using Technology-Mediated Feedback for Change

Rosemary O'Donnell et al.

JOURNAL OF THE AUSTRALIAN LIBRARY AND INFORMATION ASSOCIATION (2020)

Article Education & Educational Research

Exploring the integration of automated feedback among lower-proficiency EFL learners

Shu Huang et al.

INNOVATION IN LANGUAGE LEARNING AND TEACHING (2020)

Article Education & Educational Research

Snapping, pinning, liking or texting: Investigating social media in higher education beyond Facebook

Stefania Manca

INTERNET AND HIGHER EDUCATION (2020)

Article Education & Educational Research

Engaging with automated writing evaluation (AWE) feedback on L2 writing: Student perceptions and revisions

Zhe (Victor) Zhang

ASSESSING WRITING (2020)

Article Education & Educational Research

Science mapping the knowledge base on educational leadership and management from the emerging regions of Asia, Africa and Latin America, 1965-2018

Philip Hallinger

EDUCATIONAL MANAGEMENT ADMINISTRATION & LEADERSHIP (2020)

Article Education & Educational Research

Automated Writing Evaluation and Feedback: Multiple Metrics of Efficacy

Joshua Wilson et al.

JOURNAL OF EDUCATIONAL COMPUTING RESEARCH (2020)

Article Education & Educational Research

eRevis(ing): Students' revision of text evidence use in an automated writing evaluation system

Elaine Lin Wang et al.

ASSESSING WRITING (2020)

Review Computer Science, Interdisciplinary Applications

Digital support for academic writing: A review of technologies and pedagogies

Carola Strobl et al.

COMPUTERS & EDUCATION (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Systematic Literature Review of Automated Writing Evaluation as a Formative Learning Tool

Ana Isabel Hibert

TRANSFORMING LEARNING WITH MEANINGFUL TECHNOLOGIES, EC-TEL 2019 (2019)

Review Education & Educational Research

A Bibliometric Review of Research on Educational Administration: Science Mapping the Literature, 1960 to 2018

Philip Hallinger et al.

REVIEW OF EDUCATIONAL RESEARCH (2019)

Article Education & Educational Research

Student engagement with teacher and automated feedback on L2 writing

Zhe (Victor) Zhang et al.

ASSESSING WRITING (2018)

Article Education & Educational Research

Automated written corrective feedback: how well can students make use of it?

Jim Ranalli

COMPUTER ASSISTED LANGUAGE LEARNING (2018)

Article Computer Science, Interdisciplinary Applications

Research impact and productivity of Southeast Asian countries in language and linguistics

Jessie S. Barrot

SCIENTOMETRICS (2017)

Article Computer Science, Interdisciplinary Applications

The relationship among research productivity, research collaboration, and their determinants

Giovanni Abramo et al.

JOURNAL OF INFORMETRICS (2017)

Article Psychology, Applied

Bibliometric Methods in Management and Organization

Ivan Zupic et al.

ORGANIZATIONAL RESEARCH METHODS (2015)

Article Linguistics

Rethinking the role of automated writing evaluation (AWE) feedback in ESL writing instruction

Jinrong Li et al.

JOURNAL OF SECOND LANGUAGE WRITING (2015)

Article Education & Educational Research

The effects of computer-generated feedback on the quality of writing

Marie Stevenson et al.

ASSESSING WRITING (2014)

Review Psychology, Educational

Validating the Interpretations and Uses of Test Scores

Michael T. Kane

JOURNAL OF EDUCATIONAL MEASUREMENT (2013)

Article Education & Educational Research

On the relation between automated essay scoring and modern views of the writing construct

Paul Deane

ASSESSING WRITING (2013)

Article Computer Science, Information Systems

Using the h-index to measure the quality of journals in the field of business and management

John Mingers et al.

INFORMATION PROCESSING & MANAGEMENT (2012)

Article Education & Educational Research

Can Turnitin be used to provide instant formative feedback?

Vivien Rolfe

BRITISH JOURNAL OF EDUCATIONAL TECHNOLOGY (2011)

Review Medicine, General & Internal

Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement

David Moher et al.

PLOS MEDICINE (2009)

Article Computer Science, Information Systems

Using the h-index to rank influential information scientists

Blaise Cronin et al.

JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY (2006)

Article Education & Educational Research

Automated writing evaluation: defining the classroom research agenda

Mark Warschauer et al.

LANGUAGE TEACHING RESEARCH (2006)

Article Multidisciplinary Sciences

An index to quantify an individual's scientific research output

JE Hirsch

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2005)

Review Education & Educational Research

School engagement: Potential of the concept, state of the evidence

JA Fredricks et al.

REVIEW OF EDUCATIONAL RESEARCH (2004)