A predictive analytics framework as a countermeasure for attrition of students

Attrition is one of the main concerns in distance learning due to the impact on the incomes and institutions reputation. Timely identification of students at risk has high practical value in effective students' retention services. Big Data mining and machine learning methods are applied to manipulate, analyze and predict students' failure, supporting self-directed learning. Despite the extensive application of data mining to education, the imbalance problem in minority classes of students' attrition is often overlooked in conventional models. This document proposes a large data frame using the Hadoop ecosystem and the application of machine learning techniques to different datasets of an academic year at the Hellenic Open University. Datasets were divided into thirty-five weeks. Thirty-two classifiers were created, compared and statistical analyzed to address the minority classes' imbalance of student's failure. The algorithms metacost-SMO, and C4.5 provide the most accurate performance for each target class. Early predictions of timeframes determine a remarkable performance, while the importance of written assignments and specific quizzes is noticeable. The models' performance in any week is exploited by developing a prediction tool for student attrition, contributing to timely and personalized intervention.

Automated summary

This study focuses on the issue of student attrition in distance learning and proposes the use of big data and machine learning methods to predict student failure. The research finds that the imbalance problem in minority classes is often overlooked in conventional models, but the proposed algorithms can address this issue. Additionally, early time predictions and the significance of written assignments and specific quizzes are also highlighted.