Measuring Arithmetic Word Problem Complexity through Reading Comprehension and Learning Analytics

Numerous studies have addressed the relationship between performance in mathematics problem-solving and reading comprehension in students of all educational levels. This work presents a new proposal to measure the complexity of arithmetic word problems through the student reading comprehension of the problem statement and the use of learning analytics. The procedure to quantify this reading comprehension comprises two phases: (a) the division of the statement into propositions and (b) the computation of the time dedicated to read each proposition through a technological environment that records the interactions of the students while solving the problem. We validated our approach by selecting a collection of problems containing mathematical concepts related to fractions and their different meanings, such as fractional numbers over a natural number, basic mathematical operations with a natural whole or fractional whole and the fraction as an operator. The main results indicate that a student's reading time is an excellent proxy to determine the complexity of both propositions and the complete statement. Finally, we used this time to build a logistic regression model that predicts the success of students in solving arithmetic word problems.