Enhancing Student Performance Prediction through CNN, LSTM, and Attention Mechanisms
Abstract
This paper focuses on the study of student behavior-based grade prediction. This research investigates grade prediction based on student behavior. After evaluating student behavior data from campus events, an attention-based CNN-LSTM student grade prediction model is developed. Initially, we use Convolutional Neural Network (CNN) to extract deep student behavior features and maximum pooling approach to pick the significant features in student behavior features; the retrieved features are then used as the input of Long and Short-Term Memory networks. A temporal attention mechanism is included at the output of LSTM in order to allocate attention weights for different weekly student behavior characteristics in a reasonable manner, hence improving the model's performance in terms of prediction. Experiments revealed that the student performance prediction model suggested in this paper had excellent performance.
Show Figures
Share and Cite
Article Metrics
References
- Antoninis M, April D, Barakat B, et al. All means all: An introduction to the 2020 Global Education Monitoring Report on inclusion [J]. Prospects, 2020, 49(3): 103-9.
- Selected Drivers of Education Quality[M]. World Bank:2019-11-15.
- Notice of the Ministry of Education on the Issuance of the Action Plan of Education Informatization 2.0 [J]. Bulletin of the Ministry of Education of the People's Republic of China, 2018(04): 118-125.
- Zhang Yannan. Research on the application of big data in education [D]. East China Normal University, 2016.
- Zhou Q, Mou Chao, Yang Dan. A review of research advances in educational data mining[J]. Journal of Software, 2015, 26(11):3026-3042.
- Tom, M, Mitchell. Machine learning and data mining[J]. Communications of the ACM, 1999, 42(11):30-36.
- Krammer G , Pflanzl B , Mayr J . Using students' feedback for teacher education: measurement invariance across pre-service teacher-rated and student-rated aspects of quality of teaching[J]. Assessment & Evaluation in Higher Education, 2018:1-14.
- Notice of the State Council on the issuance of an action plan to promote the development of big data [J]. Bulletin of the State Council of the People's Republic of China,2015(26):26-35.
- United States Department of Education. Enhancing Teaching and Learning Through Data Mining and Learning Analytics - Karen Cator, U.S. Department of Education, Office of Educational.[EB/OL], https://www.ed.gov/.
- Romero C, Ventura S. Educational data mining and learning analytics: An updated survey [J]. Wiley Interdisciplinary Reviews-Data Mining and Knowledge Discovery, 2020, 10(3).
- M. Abuteir, A. El-Halees. Mining educational data to improve student’s performance:A case study[J]. International Journal of information and Communication Technology Research, 2012, 2:140-146.
- Ashenafi M M, Riccardi G, Ronchetti M. Predicting Students' Final Exam Scores From Their Course Activities[C] In: 45th Annual Frontiers in Education Conference (FIE). El Paso, TX: IEEE, 2019: 372-380.
- Oyelade O J , Oladipupo O O , Obagbuwa I C . Application of k Means Clustering algorithm for prediction of Students Academic Performance[J]. International Journal of Computer ence & Information Security, 2010, 7(1):S39.
- Kaur P, Singh M, Josan G S. Classification and prediction based data mining algorithms to predict slow learners in education sector[J]. Procedia Computer Science, 2015, 57: 500-508.
- Kaur P, Singh M, Josan G S. Classification and Prediction Based Data Mining Algorithms to Predict Slow Learners in Education Sector[J]. Procedia Computer Science, 2018, 57(6):500-508.
- Polyzou A, Karypis G. Grade Prediction With Models Specific to Students and Courses[J]. International Journal of Data Science and Analytics, 2016, 2(3):159-171.
- Fok W W T, He Y S, Yeung H H A, et al. Prediction model for students' future development by deep learning and tensorflow artificial intelligence engine[C] In:2018 4th international conference on information management (ICIM). China, Chengdu: IEEE, 2018: 103-106.
- Arsad P M, Buniyamin N. A neural network students' performance prediction model (NNSPPM)[C] In: 2013 IEEE International Conference on Smart Instrumentation, Measurement and Applications (ICSIMA). Kuala Lumpur: IEEE, 2013: 1-5.
- Aljohani N R, Fayoumi A, Hassan S U. Predicting at-risk students using clickstream data in the virtual learning environment[J]. Sustainability, 2019, 11(24): 7238.
- Corrigan O, Smeaton A F. A course agnostic approach to predicting student success from VLE log data using recurrent neural networks[C] In: European Conference on Technology Enhanced Learning. Cham, Springer: 2017: 545-548.
- Sweeney M , Lester J , Rangwala H . Next-term student grade prediction[C]// IEEE International Conference on Big Data. IEEE, 2015.
- Zhiyun Ren,Huzefa Rangwala,Aditya Johri. Predicting performance on mooc assessme-nts using multi-regression models. In Proceedings of the 9th International Confer-ence on Educational Data Mining. 2016,484--489.
- Cheng Y , Biswas G . Early Prediction of Student Dropout and Performance in MOOCs using Higher Granularity Temporal Information[J]. Journal of Learning Analytics, 2014, 1(3):169-172.
- Arthur E Poropat. A meta-analysis of the five-factor model of personality and aca-demic performance[J]. Psychological Bulletin,2009,135(2):322.
- Baradwaj B K, Pal S. Mining educational data to analyze students' performance [J]. International Journal of Advanced Computer Science and Applications, 2011, 2(6): 63-9.
- Xing W , Guo R , Eva P , et al. Participation-based student final performance prediction model through interpretable Genetic Programming: Integrating learning analytics, educational data mining and theory[J]. Computers in Human Behavior, 2015,47(jun.):168-181.
- Md Rifatul Islam Rifat,Abdullah Al Imran,ASM Badrudduza. Edunet: A deep neural network approach for predicting cgpa of undergraduate students. In Proceedings of the First International Conference on Advances in Science,Engineering and Roboti-cs Technology.IEEE,2019,1-6.
- Mashacl A Al-Barrak,Muna Al-Razgan. Predicting students final gpa using decision trees: a case study[J]. International Journal of luformation and Education Techno-logy,2016,6(7):528.
- Raheela Asif,Agathe Merceron,Syed Abbas Ali,Najmi Ghani Haider. Analyzing undergraduate students' performance using educational data mining[J]. Computers & Education,2017,113.
- Costa E B, Fonseca B, Almeida Santana M, et al. Evaluating the effectiveness of educational data mining techniques for early prediction of students' academic failure in introductory programming courses [J]. Computers in Human Behavior, 2017, 73: 247-56.
- Amra I A A, Maghari A Y A. Students performance prediction using KNN and Naive Bayesian; proceedings of the 8th International Conference on Information Technology, ICIT 2017, May 17, 2017 May 18, 2017, Amman, Jordan, F, 2017 [C]. Institute of Electrical and Electronics Engineers Inc.
- Shinichi Ocda,Genki Hashimoto. Log-data clustering analysis for dropout predictionin beginner programning classes[J]. Procedia Computer Science, 2017,112:614-621.
- Kaur G, SINGH W. Optimal Selection of Factors Influencing Student Academic Performance in Educational Data Mining [J]. Research Cell: An International Journal of Engineering Sciences, 2016, 22: 386-93.
- Rodrigues M W, Isotani S, Zarate L E. Educational Data Mining: A review of evaluation process in the e-learning [J]. Telematics and Informatics, 2018, 35(6): 1701-17.
- Karthikeyan V G, Thangaraj P, Karthik S. Towards developing hybrid educational data mining model (HEDM) for efficient and accurate student performance evaluation [J]. Soft Computing, 2020, 24(24): 18477-87.