4.3 Article

Reflections on the Application and Validation of Technology in Language Testing

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Psychology, Educational

Assessing Interactional Competence: ICE versus a Human Partner

Gary J. Ockey et al.

Summary: Most second language assessment researchers agree that interactional competence (IC) is crucial in oral communication assessment. However, assessing IC is challenging due to the need for an interlocutor. Using a Spoken Dialogue System (SDS) as a test taker's partner could mitigate these challenges. A study comparing an SDS with a human peer partner found that the SDS condition resulted in more ratable IC features, lower scores for most IC features, and more positive perceptions of the rating process.

LANGUAGE ASSESSMENT QUARTERLY (2023)

Article Psychology, Educational

Advancing Language Assessment with AI and ML- Leaning into AI is Inevitable, but Can Theory Keep Up?

Xiaoming Xi

Summary: This editorial reviews the recent advances in artificial intelligence and machine learning in language assessment and discusses the validity issues and the importance of ethical use. Accessible questions for evaluating these applications are proposed for lay users. Redefining the concept of language tests is necessary to keep up with the trends in real-world communication.

LANGUAGE ASSESSMENT QUARTERLY (2023)

Article Linguistics

Human versus Computer Partner in the Paired Oral Discussion Test

Gary J. Ockey et al.

Summary: This study explores the challenges of large-scale oral communication assessments and suggests that using a spoken dialog system can be a feasible approach. The results show that the computer partner is more reliable in assessing interactional competence, but human raters generally prefer the human partner due to its perceived authenticity and naturalness.

APPLIED LINGUISTICS (2021)

Review Psychology, Educational

Validating the Interpretations and Uses of Test Scores

Michael T. Kane

JOURNAL OF EDUCATIONAL MEASUREMENT (2013)