Enhanced Learning Behaviors and Ability Knowledge Tracing

Knowledge tracing (KT) aims to understand the evolution of students’ knowledge states during learning using machine learning techniques. While KT has made significant strides with deep learning techniques, a gap remains reflecting students’ actual knowledge level—the significant effects of students’...

Full description

Saved in:
Bibliographic Details
Main Authors: Fanglan Ma, Changsheng Zhu, Peng Lei, Peiwen Yuan
Format: Article
Language:English
Published: MDPI AG 2025-01-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/15/2/883
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832589209198657536
author Fanglan Ma
Changsheng Zhu
Peng Lei
Peiwen Yuan
author_facet Fanglan Ma
Changsheng Zhu
Peng Lei
Peiwen Yuan
author_sort Fanglan Ma
collection DOAJ
description Knowledge tracing (KT) aims to understand the evolution of students’ knowledge states during learning using machine learning techniques. While KT has made significant strides with deep learning techniques, a gap remains reflecting students’ actual knowledge level—the significant effects of students’ learning behaviors and abilities are omitted, which can reflect their knowledge acquisition more deeply and ensure the reliability of the response. This paper introduces the Enhanced Learning Behaviors and Ability Knowledge Tracing model (LBAKT), addressing this gap by incorporating both learning behavior and ability into its framework. The LBAKT model is structured into four layers: embedding, learning, forgetting, and predicting. The embedding layer enriches exercise information through an exercise embedding unit (capturing knowledge skills, exercises, and difficulty) and a learning ability embedding unit (considering answer time, answers, and hint times), forming a fundamental learning embedding. The learning layer quantifies learning gain by analyzing differences between current and previous learning embedding, interval times, and relative knowledge states, employing a learning gate to assess students’ capacity to absorb knowledge. The forgetting layer models forgetting behavior with forgotten erasing and retention functions, based on previous knowledge states, current learning gains, and interval times. Experimental results demonstrate that LBAKT outperforms existing models in terms of Area Under the Curve (AUC) and Accuracy (ACC) metrics when predicting students’ knowledge states. Specifically, on the longer sequence datasets ASSIST2012 and ASSISTChall, LBAKT achieved an AUC that is 8.8% higher than that of the worst-performing model, demonstrating superior performance. However, the model’s performance on the shorter sequence Algebra0607 was less satisfactory, with an AUC 3.16% lower and an ACC 5.0% lower than that of the top-performing model. Furthermore, our model enhances interpretability by integrating learning behavior and ability, a crucial factor for a deeper understanding of how students acquire and retain knowledge over time.
format Article
id doaj-art-aa853059bb7f413487435c4db4e41cd7
institution Kabale University
issn 2076-3417
language English
publishDate 2025-01-01
publisher MDPI AG
record_format Article
series Applied Sciences
spelling doaj-art-aa853059bb7f413487435c4db4e41cd72025-01-24T13:21:11ZengMDPI AGApplied Sciences2076-34172025-01-0115288310.3390/app15020883Enhanced Learning Behaviors and Ability Knowledge TracingFanglan Ma0Changsheng Zhu1Peng Lei2Peiwen Yuan3School of Computer and Communication, Lanzhou University of Technology, Lanzhou 730050, ChinaSchool of Computer and Communication, Lanzhou University of Technology, Lanzhou 730050, ChinaSchool of Computer and Communication, Lanzhou University of Technology, Lanzhou 730050, ChinaSchool of Computer and Communication, Lanzhou University of Technology, Lanzhou 730050, ChinaKnowledge tracing (KT) aims to understand the evolution of students’ knowledge states during learning using machine learning techniques. While KT has made significant strides with deep learning techniques, a gap remains reflecting students’ actual knowledge level—the significant effects of students’ learning behaviors and abilities are omitted, which can reflect their knowledge acquisition more deeply and ensure the reliability of the response. This paper introduces the Enhanced Learning Behaviors and Ability Knowledge Tracing model (LBAKT), addressing this gap by incorporating both learning behavior and ability into its framework. The LBAKT model is structured into four layers: embedding, learning, forgetting, and predicting. The embedding layer enriches exercise information through an exercise embedding unit (capturing knowledge skills, exercises, and difficulty) and a learning ability embedding unit (considering answer time, answers, and hint times), forming a fundamental learning embedding. The learning layer quantifies learning gain by analyzing differences between current and previous learning embedding, interval times, and relative knowledge states, employing a learning gate to assess students’ capacity to absorb knowledge. The forgetting layer models forgetting behavior with forgotten erasing and retention functions, based on previous knowledge states, current learning gains, and interval times. Experimental results demonstrate that LBAKT outperforms existing models in terms of Area Under the Curve (AUC) and Accuracy (ACC) metrics when predicting students’ knowledge states. Specifically, on the longer sequence datasets ASSIST2012 and ASSISTChall, LBAKT achieved an AUC that is 8.8% higher than that of the worst-performing model, demonstrating superior performance. However, the model’s performance on the shorter sequence Algebra0607 was less satisfactory, with an AUC 3.16% lower and an ACC 5.0% lower than that of the top-performing model. Furthermore, our model enhances interpretability by integrating learning behavior and ability, a crucial factor for a deeper understanding of how students acquire and retain knowledge over time.https://www.mdpi.com/2076-3417/15/2/883knowledge tracinglearning behaviorslearning abilityforgetting effectonline learning systemdeep learning
spellingShingle Fanglan Ma
Changsheng Zhu
Peng Lei
Peiwen Yuan
Enhanced Learning Behaviors and Ability Knowledge Tracing
Applied Sciences
knowledge tracing
learning behaviors
learning ability
forgetting effect
online learning system
deep learning
title Enhanced Learning Behaviors and Ability Knowledge Tracing
title_full Enhanced Learning Behaviors and Ability Knowledge Tracing
title_fullStr Enhanced Learning Behaviors and Ability Knowledge Tracing
title_full_unstemmed Enhanced Learning Behaviors and Ability Knowledge Tracing
title_short Enhanced Learning Behaviors and Ability Knowledge Tracing
title_sort enhanced learning behaviors and ability knowledge tracing
topic knowledge tracing
learning behaviors
learning ability
forgetting effect
online learning system
deep learning
url https://www.mdpi.com/2076-3417/15/2/883
work_keys_str_mv AT fanglanma enhancedlearningbehaviorsandabilityknowledgetracing
AT changshengzhu enhancedlearningbehaviorsandabilityknowledgetracing
AT penglei enhancedlearningbehaviorsandabilityknowledgetracing
AT peiwenyuan enhancedlearningbehaviorsandabilityknowledgetracing