Data-driven Knowledge Tracing to Improve Learning Outcomes

What you will learn in the course

Start Any Time

Work on your pace and you will have instructors available to help you answer any questions.


Approximately 3 weeks, 6-8 hours/week


Normally $1500. Now $750 for the course first run in October 2021 only.

Certificate Course Description:

Online learning has become widespread and many claim it will revolutionize education by adapting to the individual learner’s needs. Yet, this is a complex task. To meet this goal instruction must take into account how learners are different, how they are similar, and how they change as they learn.

In this course, you will learn methods to adapt to learner needs that are supported by research taking into account multiple psychological realms, such as combinations of knowledge, path through problem, and affect. You will learn how advanced learning technologies that adapt to learners can provide individualized experiences that optimize learning. You will be exposed to a number of proven personalization techniques used in advanced learning technologies. We will also survey newer techniques, such as personalizing based on student metacognition, affect, and motivation. Finally, we will look at personalization approaches that are widely believed to be effective but have not proven to be so.

Module 1: Mastery
  • Define ITS instructional features and design space as described by VanLehn
  • Describe knowledge component modeling
  • Describe Cognitive Mastery (mainly N-Consecutive Correct responses heuristic and Bayesian Knowledge Tracing)
  • Predict student performance using Bayesian Knowledge Tracing
  • Apply data-driven tuning of cognitive mastery
  • Explain how wheel spinning relates to cognitive mastery


Module 2: KC Modeling
  • Describe knowledge component modeling
  • Explain ways to implement a KC model
  • Describe data-driven KC model revision
  • Evaluate a KC model with Additive Factors Model (AFM)


Module 3: Cognitive Task Analysis
  • Define Cognitive Task Analysis (CTA) and its purpose
  • Classify a given CTA based on the type and identify its target use
  • Articulate the process of the Think-aloud method
  • Articulate the process of the Difficulty Factor Assessment (DFA) method
  • Compare advantages of DFA and Think-aloud


Module 4: Learning Factors Analysis (LFA)
  • Explain the role of cognitive task analysis in scaling instructional impact
  • Explain how to discover a cognitive model via search
  • Interpret and generalize the cognitive process
  • Describe system redesign in light of a new cognitive model


Module 5: Course Project

At the end of the course, you’ll have an opportunity to do a little project where you will refine a system’s KC model so it better aligns with student learning. That will provide you with a nice experience to apply the fundamentals you will learn in the modules to a larger, more authentic, context. It will be graded by the instructor and you will receive personalized feedback along with a sample solution.

Researchers, product/UX designers, and instructional designers who want to develop adaptive and personalized educational experiences. Administrators who want to gain a deep understanding of how personalized learning is delivered. Anyone interested in edtech.

What you'll learn

This course will help you:

  • Explain how to implement and predict student performance using Knowledge Tracing Algorithms 
    • N-Consecutive Correct responses heuristic
    • Bayesian Knowledge Tracing
  • Explain ways to implement a KC model and evaluate it with Additive Factors Model (AFM)
  • Generate an initial KC model and alternative KC model candidates using Cognitive Task Analysis (CTA)
  • Discover an efficient cognitive model via search and perform a system redesign in light of a new cognitive model

Course Instructors

Dr. Vincent Aleven

Dr. Vincent Aleven is a Professor in Carnegie Mellon’s Human-Computer Interaction Institute (HCII). He has 20 years of experience in research and development of advanced learning technologies, grounded in cognitive theory.

[Read More]

Dr. Ken Koedinger

is a professor of Human-Computer Interaction and Psychology at Carnegie Mellon University. Dr. Koedinger has an M.S. in Computer Science, a Ph.D. in Cognitive Psychology, and experience teaching in an urban high school. His multidisciplinary background supports his research goals of understanding human learning and creating educational technologies…

[Read More]


Upon successful completion of the program, participants will receive a verified digital certificate of completion from Carnegie Mellon University’s Open Learning Initiative.

In addition to the knowledge and immediately applicable frameworks you will gain by attending your selected courses, you will benefit from:

  • A digital, verified version of your Executive Certificate (Smart Certificate) you can add to your resume and LinkedIn
  • Networking with a global group of your peers and instructors for advancing your career

Register Now

Register and start taking the course in four steps:

1. Enter your email address 

2. Watch this short video for instructions on how to register in OLI.

3. For this course, copy the course key: DKT-001

4. Click on this link to Carnegie Mellon University’s Open Initiative to register and try out the course for 48 hours before payment is due.

5. (Optional but highly recommended) Set OLI to automatically resume from where you left off in the course.

1) Click on your name in the upper right corner to bring up your OLI profile settings.

2) Change the option on the dropdown to resume automatically.

3) Lastly, select UPDATE.

You are all set!

Set up course to auto resume in OLI