Ensemble Approach for Predicting Student's Academic Performance

Authors: L. A. Muhammad, M. S. Argungu

Abstract:

Educational data mining (EDM) has recorded substantial considerations. Techniques of data mining in one way or the other have been proposed to dig out out-of-sight knowledge in educational data. The result of the study got assists academic institutions in further enhancing their process of learning and methods of passing knowledge to students. Consequently, the performance of students boasts and the educational products are by no doubt enhanced. This study adopted a student performance prediction model premised on techniques of data mining with Students' Essential Features (SEF). SEF are linked to the learner's interactivity with the e-learning management system. The performance of the student's predictive model is assessed by a set of classifiers, viz. Bayes Network, Logistic Regression, and Reduce Error Pruning Tree (REP). Consequently, ensemble methods of Bagging, Boosting, and Random Forest (RF) are applied to improve the performance of these single classifiers. The study reveals that the result shows a robust affinity between learners' behaviors and their academic attainment. Result from the study shows that the REP Tree and its ensemble record the highest accuracy of 83.33% using SEF. Hence, in terms of the Receiver Operating Curve (ROC), boosting method of REP Tree records 0.903, which is the best. This result further demonstrates the dependability of the proposed model.

Keywords: Ensemble, bagging, Random Forest, boosting, data mining, classifiers, machine learning.

References:

[1] Amrieh, E. A., Hamtini, T., & Aljarah, I. (2016). Mining Educational Data to Predict Student’s Academic Performance Using Ensemble Methods. International Journal of Database Theory and Application, 9(8), 209–213. https://doi.org/10.14257/ijdta.2016.9.8.13
[2] Bendangnuksung, R. K & Prabu, E. P. (2018). Early Dropout Prediction Using Data Mining: A Case Study with High School Students. International Journal of Applied Engineering Research ISSN 0973-4562 Volume 13, Number 2 (2018) pp. 1171-1176
[3] Devasia, M. T., P, M. V. T., & Hegde, V. (2016). Prediction of Students Performance Using Educational Data Mining. In Department of Computer Science Amrita Vishwa Vidyapeetham University, Mysuru Campus Mysuru, Karnataka, India (p. 190).
[4] Gupta, A., Gupta, S., & Singh, D. (2015). A Systematic Review of Classification Techniques and Implementation of ID3 Decision Tree Algorithm. In International Conference on System Modeling & Advancement in Research Trends (SMART) (pp. 144–152).
[5] Han, H. U. I. X., & Jie, J. S. U. N. (2009). Financial Distress Prediction Based on Ensemble Classifiers of Multiple Reductions. International Conference on Management Science & Engineering (pp. 1247–1252).
[6] Hodžić, A., Kevrić, J., & Karadag, A. (2016). Comparison of Machine Learning Techniques in Phishing Websites. In International Conference on Economic and Social Studies (ICESoS)) 2016 (pp. 249–256).
[7] Mhetre, V. (2017). Classification-Based Data Mining Algorithms to Predict Slow, Average, and Fast Learners in Educational System Using Weka. In Proceedings of the IEEE 2017 International Conference on Computing Methodologies and Communication (pp. 475–479).
[8] Mousa, H., & Maghari, A. (2017). School Students â€TM Performance Prediction Using Data Mining Classification. International Journal of Advanced Research in Computer and Communication Engineering ISO, 6(8), 136–141. https://doi.org/10.17148/IJARCCE.2017.6824
[9] Osokoya, I. J (2009). Mining Educational Data to Predict Student’s Academic Performance Using Ensemble Methods. And Theory International Journal Application, Database of 9(8), 209–213.https://doi.org/10.14257/ijdta.2016.9.8.13
[10] Olukoya, B. M (2018). Mining Educational Data to Predict Student's Academic Performance. International Journal on Recent and Innovation Trends in Computing and Communication, 4(1), 1–5.
[11] Phil, M., & Shoba, S. A. (2017). Educational data Mining & Students Performance Prediction Using SVM Techniques. International Research Journal of Engineering and Technology (IRJET), 4(8), 1248–1254.
[12] Roy, S. (2017). Predicting Academic Performance of Students Using Classification Techniques. In 4th IEEE Uttar Pradesh Section International Conference on Electrical, Computer, and Electronics (pp. 568–572).
[13] Roy, S., & Garg, A. (2017). Predicting Academic Performance of Students Using Classification Techniques. In 4th IEEE Uttar Pradesh Section International Conference on Electrical, Computer, and Electronics (pp. 568–572). Mathura.
[14] Shet, S. (2014). Approach for Predicting Student Performance Using Ensemble Model Method. International Journal of Innovative Research in Computer and Communication Engineering, 2(5), 161–169.
[15] Suharjito, Diana, & Herianto. (2017). Implementation of Classification Technique in Web Usage Mining of Banking Company. In Proceeding - 2016 International Seminar on Intelligent Technology and Its Application, ISITIA 2016: Recent Trends in Intelligent Computational Technologies for Sustainable Energy (pp. 211–218). https://doi.org/10.1109/ISITIA.2016.7828660
[16] Vinodhini, G., & Chandrasekaran, R. M. (2018). Predicting Students’ Academic Performance in the University Using Meta Decision Tree Classifiers. Journal of Computer Science, 15(12), 1–8. https://doi.org/10.3844/jcssp.2018.654.662
[17] Wati, M., Indrawan, W., Widians, J. A., & Puspitasari, N. (2017). Data Mining for Predicting Students ' Learning Results. In Dept. of Computer Science and Information Technology Universitas Mulawarman Samarinda, Indonesia (p. 28).