Abstract

Learning analytics (LA) is the measuring, gathering, analyzing, and reporting of data on learners and their environments. This data is used to analyze and improve e-learning. LA has traditionally been used for a variety of purposes, including the prediction of student academic progress and more specifically, the identification of students who are in danger of failing a course or quitting their studies. However, the majority of the existing schemes have the issue of accurately predicting the students’ performance in online courses. In this paper, correlation-based self-attention network-long short-term memory (SAN-LSTM) is proposed to predict students’ outcomes, along with the effectiveness of the teaching experience, as well as the assessment methods. Initially, the data is collected from three datasets namely, WorldUC, Liru, and Junyi to evaluate the performance of the proposed approach. The min-max normalization is employed to improve the performance of the approach. The correlation-based feature selection (CFS) is employed to select appropriate features from the pre-processed data. Finally, the correlation-based SAN-LSTM is established to forecast the effectiveness of fine-grained learning. Three real-world datasets gathered from various e-learning empirically validated that the proposed model improves prediction outcomes and provides useful data for formative evaluation. The existing methods such as adaptive sparse self-attention network (AS-SAN), Bangor engagement metric (BEM), and deep belief network learning style (DBNLS) are used for comparison to justify the effectiveness of the correlation-based SAN-LSTM method. The proposed correlation-based SAN-LSTM achieves better results of 98% of accuracy and 93% of precision. The proposed method achieves 98% accuracy which is higher when compared to those of AS-SAN, BEM, and DBNLS.

Keyword

Correlation-based self-attention network-long short-term memory, E-learning, Feedback, Fine-grained performance prediction, Long-term feature development.

Cite this article

Narayan V, Ganapathisamy S.Learning analytics with correlation-based SAN-LSTM mechanism for formative evaluation and improved online learning . International Journal of Advanced Technology and Engineering Exploration. 2024;11(112):373-387. DOI:10.19101/IJATEE.2023.10102002

Refference

[1]Maher Y, Moussa SM, Khalifa ME. Learners on focus: visualizing analytics through an integrated model for learning analytics in adaptive gamified e-learning. IEEE Access. 2020; 8:197597-616.

[2]Kawamura R, Shirai S, Takemura N, Alizadeh M, Cukurova M, Takemura H, et al. Detecting drowsy learners at the wheel of e-learning platforms with multimodal learning analytics. IEEE Access. 2021; 9:115165-74.

[3]Paneque M, Del MRM, García-nieto J. e-LION: data integration semantic model to enhance predictive analytics in e-Learning. Expert Systems with Applications. 2023; 213:118892.

[4]Wang D, Han H. Applying learning analytics dashboards based on processoriented feedback to improve students learning effectiveness. Journal of Computer Assisted Learning. 2021; 37(2):487-99.

[5]Shahbazi Z, Byun YC. Agent-based recommendation in E-learning environment using knowledge discovery and machine learning approaches. Mathematics. 2022; 10(7):1-19.

[6]Díaz RRP, Caeiro RM, López EJJ, Fernández VA. Integrating micro-learning content in traditional e-learning platforms. Multimedia Tools and Applications. 2021; 80(2):3121-51.

[7]Distante D, Villa M, Sansone N, Faralli S. MILA: a SCORM-compliant interactive learning analytics tool for moodle. In 20th international conference on advanced learning technologies 2020 (pp. 169-71). IEEE.

[8]Hasan R, Palaniappan S, Mahmood S, Abbas A, Sarker KU, Sattar MU. Predicting student performance in higher educational institutions using video learning analytics and data mining techniques. Applied Sciences. 2020; 10(11):1-20.

[9]Muñoz S, Sánchez E, Iglesias CA. An emotion-aware learning analytics system based on semantic task automation. Electronics. 2020; 9(8):1-24.

[10]Abideen ZU, Mazhar T, Razzaq A, Haq I, Ullah I, Alasmary H, et al. Analysis of enrollment criteria in secondary schools using machine learning and data mining approach. Electronics. 2023; 12(3):1-25.

[11]Hmedna B, El MA, Baz O. A predictive model for the identification of learning styles in MOOC environments. Cluster Computing. 2020; 23(2):1303-28.

[12]Pal S, Pramanik PK, Choudhury P. Enhanced metadata modelling and extraction methods to acquire contextual pedagogical information from e-learning contents for personalised learning systems. Multimedia Tools and Applications. 2021; 80(16):25309-66.

[13]Li Q, Duffy P, Zhang Z. A novel multi-dimensional analysis approach to teaching and learning analytics in higher education. Systems. 2022; 10(4):1-18.

[14]Khalil M, Topali P, Ortega-arranz A, Er E, Akçapınar G, Belokrys G. Video analytics in digital learning environments: exploring student behaviour across different learning contexts. Technology, Knowledge and Learning. 2023:1-29.

[15]Ozdamli F, Aljarrah A, Karagozlu D, Ababneh M. Facial recognition system to detect student emotions and cheating in distance learning. Sustainability. 2022; 14(20):1-19.

[16]Ma Y, Wei Y, Shi Y, Li X, Tian Y, Zhao Z. Online learning engagement recognition using bidirectional long-term recurrent convolutional networks. Sustainability. 2022; 15(1):1-14.

[17]Han I, Obeid I, Greco D. Multimodal learning analytics and neurofeedback for optimizing online learners’ self-regulation. Technology, Knowledge and Learning. 2023; 28(4):1937-43.

[18]Wong BT, Li KC, Cheung SK. An analysis of learning analytics in personalised learning. Journal of Computing in Higher Education. 2023; 35(3):371-90.

[19]Li L, Farias HL, Liang L, Law N. An outcome-oriented pattern-based model to support teaching as a design science. Instructional Science. 2022:1-32.

[20]Banihashem SK, Farrokhnia M, Badali M, Noroozi O. The impacts of constructivist learning design and learning analytics on students’ engagement and self-regulation. Innovations in Education and Teaching International. 2022; 59(4):442-52.

[21]Rets I, Herodotou C, Bayer V, Hlosta M, Rienties B. Exploring critical factors of the perceived usefulness of a learning analytics dashboard for distance university students. International Journal of Educational Technology in Higher Education. 2021; 18:1-23.

[22]Wang X, Mei X, Huang Q, Han Z, Huang C. Fine-grained learning performance prediction via adaptive sparse self-attention networks. Information Sciences. 2021; 545:223-40.

[23]Tawafak RM, Romli AB, Alsinani M. E-learning system of UCOM for improving student assessment feedback in Oman higher education. Education and Information Technologies. 2019; 24:1311-35.

[24]Gray CC, Perkins D. Utilizing early engagement and machine learning to predict student outcomes. Computers & Education. 2019; 131:22-32.

[25]Rajabalee YB, Santally MI. Learner satisfaction, engagement and performances in an online module: implications for institutional e-learning policy. Education and Information Technologies. 2021; 26(3):2623-56.

[26]Ez-zaouia M, Tabard A, Lavoué E. EMODASH: a dashboard supporting retrospective awareness of emotions in online learning. International Journal of Human-Computer Studies. 2020; 139:102411.

[27]Zhang H, Huang T, Liu S, Yin H, Li J, Yang H, et al. A learning style classification approach based on deep belief network for large-scale online education. Journal of Cloud Computing. 2020; 9:1-7.

[28]Ma R, Zhang L, Li J, Mei B, Ma Y, Zhang H. Dtkt: an improved deep temporal convolutional network for knowledge tracing. In 16th international conference on computer science & education 2021 (pp. 794-9). IEEE.

[29]Zhao S, Wang C, Sahebi S. Transition-aware multi-activity knowledge tracing. In IEEE international conference on big data (Big Data) 2022 (pp. 1760-9). IEEE.

[30]Ke F, Wang W, Tan W, Du L, Jin Y, Huang Y, et al. HiTSKT: a hierarchical transformer model for session-aware knowledge tracing. Knowledge-Based Systems. 2024; 284:111300.

[31]Yang CC, Ogata H. Personalized learning analytics intervention approach for enhancing student learning achievement and behavioral engagement in blended learning. Education and Information Technologies. 2023; 28(3):2509-28.

[32]Hilliger I, Aguirre C, Miranda C, Celis S, Pérez-sanagustín M. Lessons learned from designing a curriculum analytics tool for improving student learning and program quality. Journal of Computing in Higher Education. 2022; 34(3):633-57.

[33]Hadyaoui A, Cheniti-belcadhi L. Ontology-based group assessment analytics framework for performances prediction in project-based collaborative learning. Smart Learning Environments. 2023; 10(1):1-27.

[34]Jääskelä P, Heilala V, Kärkkäinen T, Häkkinen P. Student agency analytics: learning analytics as a tool for analysing student agency in higher education. Behaviour & Information Technology. 2021; 40(8):790-808.

[35]Mubarak AA, Cao H, Zhang W. Prediction of students’ early dropout based on their interaction logs in online learning environment. Interactive Learning Environments. 2022; 30(8):1414-33.

[36]Ouyang F, Wu M, Zheng L, Zhang L, Jiao P. Integration of artificial intelligence performance prediction and learning analytics to improve student learning in online engineering course. International Journal of Educational Technology in Higher Education. 2023; 20(1):1-23.

[37]Bhattacharya S, Biswas U, Damkondwar S, Yadav B. Real-time ICT-based interactive learning analytics to facilitate blended classrooms. Education and Information Technologies. 2023:1-31.

[38]Yan H, Lin F, Kinshuk. Including learning analytics in the loop of self-paced online course learning design. International Journal of Artificial Intelligence in Education. 2021; 31(4):878-95.

[39]Cole AW, Lennon L, Weber NL. Student perceptions of online active learning practices and online learning climate predict online course engagement. Interactive Learning Environments. 2021; 29(5):866-80.

[40]Fu Q, Bai X, Zheng Y, Du R, Wang D, Zhang T. VisOJ: real-time visual learning analytics dashboard for online programming judge. The Visual Computer. 2023; 39(6):2393-405.

[41]El SA, Al AW. Improvement in student performance and perceptions through a flipped anatomy classroom: shifting from passive traditional to active blended learning. Anatomical Sciences Education. 2021; 14(4):482-90.

[42]Albó L, Barria-pineda J, Brusilovsky P, Hernández-leo D. Knowledge-based design analytics for authoring courses with smart learning content. International Journal of Artificial Intelligence in Education. 2022; 32(1):4-27.

[43]Kaliisa R, Dolonen JA. CADA: a teacher-facing learning analytics dashboard to foster teachers’ awareness of students’ participation and discourse patterns in online discussions. Technology, Knowledge and Learning. 2023; 28(3):937-58.

[44]Sridharan TB, Akilashri PS. Hybrid attention network-based students behavior data analytics framework with enhanced capuchin search algorithm using multimodal data. Social Network Analysis and Mining. 2023; 13(1):145.

[45]Cope B, Kalantzis M, Searsmith D. Artificial intelligence for education: knowledge and its assessment in AI-enabled learning ecologies. Educational Philosophy and Theory. 2021; 53(12):1229-45.

[46]Preuveneers D, Garofalo G, Joosen W. Cloud and edge based data analytics for privacy-preserving multi-modal engagement monitoring in the classroom. Information Systems Frontiers. 2021; 23(1):151-64.

[47]Rani M, Gagandeep. Effective network intrusion detection by addressing class imbalance with deep neural networks multimedia tools and applications. Multimedia Tools and Applications. 2022; 81(6):8499-518.

[48]Park J, Jeong J, Park Y. Ship trajectory prediction based on bi-LSTM using spectral-clustered AIS data. Journal of Marine Science and Engineering. 2021; 9(9):1-22.

[49]Arunkumar KE, Kalaga DV, Kumar CM, Kawaji M, Brenza TM. Forecasting of COVID-19 using deep layer recurrent neural networks (RNNs) with gated recurrent units (GRUs) and long short-term memory (LSTM) cells. Chaos, Solitons & Fractals. 2021; 146:110861.

[50]Wang X, Zhang L, He T. Learning performance prediction-based personalized feedback in online learning via machine learning. Sustainability. 2022; 14(13):1-16.

[51]https://github.com/DeepReSTProject/The-LiruNET-2018-dataset/?tab=readme-ov-file. Accessed 26 February 2024.

[52]https://www.kaggle.com/datasets/junyiacademy/learning-activity-public-dataset-by-junyi-academy. Accessed 26 February 2024.