An automatic short-answer grading model for semi-open-ended questions

Automatic short-answer grading has been studied for more than a decade. The technique has been used for implementing auto assessment as well as building the assessor module for intelligent tutoring systems. Many early works automatically grade mainly based on the similarity between a student answer and the reference answer to the question. This method performs well for closed-ended questions that have single or very limited numbers of correct answers. However, some short-answer questions ask students to express their own thoughts based on various facts; hence, they have no reference answers. Such questions are called semi-open-ended short-answer questions. Questions of this type often appear in reading comprehension assessments. In this paper, we developed an automatic semi-open-ended short-answer grading model that integrates both domain-general and domain-specific information. The model also utilizes a long-short-term-memory recurrent neural network to learn the representation in the classifier so that word sequence information is considered. In experiments on 7 reading comprehension questions and over 16,000 short-answer samples, our proposed automatic grading model demonstrates its advantage over existing models.

Automated summary

Automatic short-answer grading has been studied for more than a decade. This technique has been used for auto assessment and intelligent tutoring systems. Most early works grade based on similarity to the reference answer, but struggle with semi-open-ended questions. This paper proposes a model that integrates domain-general and domain-specific information, using a recurrent neural network to consider word sequence information, and demonstrates its advantage in experiments.