Hybrid deep learning approach with attention mechanism for predicting student success in higher education institutions

Higher education institutions are focusing increasingly on targeted interventions by supporting students with academic challenges, improving their overall learning outcomes. In this context, hybrid Deep Learning (DL) approaches have emerged as leaders in the construction of recommendation systems ca...

Full description

Saved in:
Bibliographic Details
Main Authors: Nazir, Muhammad, Noraziah, Ahmad, Alsaleh, Abdullah, Rahmah, Mokhtar
Format: Article
Language:en
en
Published: Engineering and Technology Publishing 2026
Subjects:
Online Access:https://umpir.ump.edu.my/id/eprint/47241/1/Hybrid%20deep%20learning%20approach%20with%20attention%20mechanism.pdf
https://umpir.ump.edu.my/id/eprint/47241/7/Hybrid%20deep%20learning%20approach%20with%20attention%20mechanism%20for%20predicting%20student.pdf
https://doi.org/10.12720/jait.17.3.500-518
https://umpir.ump.edu.my/id/eprint/47241/
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Higher education institutions are focusing increasingly on targeted interventions by supporting students with academic challenges, improving their overall learning outcomes. In this context, hybrid Deep Learning (DL) approaches have emerged as leaders in the construction of recommendation systems capable of predicting students-at-risk by analyzing patterns of historical academic data. This paper proposes a hybrid DL model integrating an attention mechanism, specifically tailored to predict the success of students and to identify students-in-need of academic support. Our primary dataset, sourced from the Majmaah University of the Kingdom of Saudi Arabia, contained 146,989 records and 26 features, including a wide variety of student-related features crucial for making academic achievement predictions. Comparison with the current models like Artificial Neural Network (ANN), Convolutional Neural Network (CNN), Gated Recurrent Unit (GRU), Neural Network Random Weight (NNRW), Long Short-Term Memory (LSTM), and NNRW-LSTM demonstrates the exemplary effectiveness of the proposed NNRW-LSTM model integrated with an attention mechanism. The proposed model achieved remarkable accuracy of 93.53%, 92.85% of the recall rate, 92.6% of precision, and 92.55 of the F1-Score. These results document the prospect of this hybrid DL model integrated with an attention mechanism to assist schools in identifying students-at-risk proactively, facilitating interventions well in time and helping curb academic underperformance and dropouts.