Hyperparameter Optimization of Ensemble Models for Spam Email Detection

Unsolicited emails, popularly referred to as spam, have remained one of the biggest threats to cybersecurity globally. More than half of the emails sent in 2021 were spam, resulting in huge financial losses. The tenacity and perpetual presence of the adversary, the spammer, has necessitated the need for improved efforts at filtering spam. This study, therefore, developed baseline models of random forest and extreme gradient boost (XGBoost) ensemble algorithms for the detection and classification of spam emails using the Enron1 dataset. The developed ensemble models were then optimized using the grid-search cross-validation technique to search the hyperparameter space for optimal hyperparameter values. The performance of the baseline (un-tuned) and the tuned models of both algorithms were evaluated and compared. The impact of hyperparameter tuning on both models was also examined. The findings of the experimental study revealed that the hyperparameter tuning improved the performance of both models when compared with the baseline models. The tuned RF and XGBoost models achieved an accuracy of 97.78% and 98.09%, a sensitivity of 98.44% and 98.84%, and an F1 score of 97.85% and 98.16%, respectively. The XGBoost model outperformed the random forest model. The developed XGBoost model is effective and efficient for spam email detection.

Automated summary

Unsolicited emails, or spam, have posed a major cybersecurity threat globally, with more than half of the emails sent in 2021 being spam and resulting in significant financial losses. This study developed ensemble models using random forest and XGBoost algorithms to detect and classify spam emails. The findings showed that hyperparameter tuning improved the performance of both models, with the XGBoost model outperforming the random forest model in terms of accuracy, sensitivity, and F1 score.