E-Learning Design Principles and Methods 2016

From LearnLab
Revision as of 20:50, 25 August 2014 by Koedinger (talk | contribs) (Flipped Homework: Reading Reports and Reading Quizzes)
Jump to: navigation, search

Course Details

Course number: 05-823

Semester: Fall 2014

Carnegie Mellon University

Class times

10:30 to 11:50 Tuesday & Thursday


104 South Craig St (SCR)


Professor Ken Koedinger

Office: 3601 Newell-Simon Hall, Phone: 412-268-7667

Email: Koedinger@cmu.edu, Office hours by appointment

Course Prerequisites

To enroll you must either be in the Masters of Educational Technology and Applied Learning Science (METALS) or get the permission of the instructor.

Textbook and Readings

"E-Learning and the Science of Instruction: 3rd edition" by Ruth Colvin Clark and Richard E. Mayer.

Other readings will be assigned in class. See below.

Class URLs

Syllabus and useful links: learnlab.org/research/wiki/index.php/E-learning_Design_Principles_2014

For quizzes and reading reports go www.cmu.edu/blackboard.


This course is about e-learning design principles, the evidence and theory behind them, and how to apply these principles to develop effective educational technologies. It is organized around the book "e-Learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning" by Clark & Mayer with further readings drawn from cognitive science, educational psychology, and human-computer interaction. You will learn design principles 1) for combining words, audio, and graphics in multimedia instruction, 2) for combining examples, explanations, practice and feedback in online support for learning by doing, and 3) for balancing learner versus system control and supporting student metacognition. You will read about the experiments that support these design principles, see examples of how to design such experiments, and practice applying the principles in educational technology development.

Flipped Homework: Reading Quizzes and Reading Reports

You will have "flipped homework", a variation on the flipped classroom idea you might have heard of. Flipped homework is an assignment before a relevant class meeting rather than after it. It helps you to check your understanding of what you read, to practice to enhance your memory (we will talk about the "testing effect" in class), and to get a better sense of what you don't know so you are prepared to ask questions in class. It also helps instructors focus the class discussion to better avoid belaboring known points and pursue student needs and interests.

Before some class sessions, you will asked to do a quiz associated with the assigned book chapter. The quizzes will be on the Blackboard site (www.cmu.edu/blackboard, the course is listed as "Special Topics in HCI"). Before other class sessions, you will be asked to write "reading reports". We will use the discussion board on Blackboard. You should complete assigned quizzes or reading reports before 9am on the day of class.

For reading reports, the discussion forum post will usually direct you as to how to reply. If not otherwise directed, you should make two posts on the readings. Your two posts may be original or in response to another post (one of both is nice).

  • Original posts should contain one or more of the following:
    • something you learned from the reading or slides
    • a question you have about the reading or slides or about the topic in general
    • a connection with something you learned or did previously in this or another course, or in other professional work or research
  • Replies should be an on-topic, relevant response, clarification, or further comment on another student’s post.

In general, please come to class prepared to ask questions and give answers.


  • 40% Final Project
    • 30% Six parts of final project, 5% each
    • 10% Final project submission
  • 5% E-Learning examples assignment
  • 15% Midterm exam
  • 15% Pre-class quizzes & reading reports
  • 20% Chapter summary
  • 5% Class participation

Class Schedule in Brief

  • E-Learning Introduction 8-26 to 9-4
    • Aug 26 Overview; Examples Assignment; Project
    • Aug 28 1.E-learning; KLI Framework events (The "1." indicates this is a chapter in the Clark & Mayer book)
    • Sept 2 2.How People Learn; KLI KC's
    • Sept 4 3.Evidence-based practice; KLI Learning & Instructional Events
  • Instructional Goals and Cognitive Task Analysis 9-9 to 9-16
    • Sept 9 Determining instructional goals (tasks)
    • Sept 11 Guest lecture
    • Sept 16 Discovering learning objectives (KCs) & Rational Cognitive Task Analysis
  • Multimedia Principles and Cognitive Task Analysis 9-18 to 10-16
    • Sept 18 4.Multi-media Principle
    • Sept 23 Empirical Cognitive Task Analysis: Think aloud
    • Sept 25 5.Contiguity Principle
    • Sept 30 CTA: DFA & Model building
    • Oct 2 6.Modality Principle & 7.Redundancy Principle
    • Oct 7 CTA & Designing Assessments for Continual Improvement
    • Oct 9 8.Coherence Principle & Midterm review
    • Oct 14 9.Personalization Principle
    • Oct 16 Midterm exam & Flex topic
  • Learning By Doing Principles 10-21 to 11-18
    • Oct 21 10.Segmenting and Pretraining
    • Oct 23 KLI & Selecting appropriate instructional principles
    • Oct 28 11.Leveraging Examples in E-Learning
    • Oct 30 12.Does Practice Make Perfect
    • Nov 4 13.Learning Together Virtually
    • Nov 6 14.Who’s in Control?
    • Nov 11 15.E-Learning to Build Problem Solving Skill
    • Nov 13 16.Simulations and Games
    • Nov 18 17.Applying the Guidelines
  • Project Presentations 11-20 to 12-5
    • Nov 20 Project Presentations
    • Nov 25 Project Presentations
    • Nov 27 Thanksgiving, no class
    • Dec 2 Project Presentations
    • Dec 4 Project Presentations
  • Final Project due Dec 12

Class Schedule with Readings and Assignments

NOTE: This section is "living" -- it will grow and change as the semester goes on.

E-Learning Introduction 8-26 to 9-4
  • 8-26 Overview, course project, your interests
    • Class activity: Discuss your interests in e-learning
    • Assignment: Examples (click to get) is due next Thursday, 9-4
      • BRING two screen shots of your first example to next class
    • Assignment: Project step 1 is due in 16 days on Thursday, 9-11
    • NOTE: See reading assignment for next time on next date.
  • 8-28 E-learning intro and KLI Framework events (Click here for slides)
    • Class activity: Promises & pitfalls review of e-learning examples
      • BRING two screen shots of your first example to this class
    • Reading (from course book): 1.e-Learning: Promise & Pitfalls (28 pages). You can get this chapter here this time but order the book right now!
      • Pre-class quiz: Answer questions for Chpt1 Quiz on Blackboard
    • For next time:
      • BRING two screen shots of your second example to this class
      • Review project step1 and come with a preliminary project idea. You might write some thoughts down, but you do not need to hand anything in.
      • a) Do the two readings, b) associated quiz & c) discussion board post on Blackboard
  • 9-2 How People Learn and KLI Knowledge Components (Slides)
    • Read Ch2.How Do People Learn from E-Courses (20 pages) You can get this chapter here this last time!
      • Pre-class quiz: Answer questions for Chpt2 Quiz on Blackboard (5 minutes)
    • Read KLI Framework paper sections 1-3 (18 pages)
      • Make one post to Blackboard -- see questions in Forum introduction
    • Class activity: KC type in e-learning examples
      • BRING two screen shots of your second example to this class.
    • Class activity: Project idea discussion
      • Come prepared with a preliminary project idea
  • 9-4 Evidence-based practice and KLI Learning & Instructional Events Media: (Slides)
    • Reading: 3.Evidence-based practice (18 pages)
      • Pre-class quiz: Answer questions for Chpt3 Quiz on Blackboard
    • Reading: KLI sect 4-5 (12 pages)
      • Make one post to Blackboard -- see questions in Forum introduction
    • Class activity: Principles present in e-learning examples
    • DUE: Examples assignment is due at beginning of class. Please submit on blackboard.
Instructional Goals and Cognitive Task Analysis 9-9 to 9-16
  • 9-9 Goals, assessment tasks, cognitive task analysis, and instructional design
    • Class activity: Review Project ideas and step 1 write-up requirements; consider assessment tasks
    • Reading: Feldon paper
      • Posts: Do two posts on the Feldon reading.
  • 9-11 Cognitive Task Analysis and Think Alouds by guest lecturer Vincent Aleven
    • DUE: Project step P1: Domain, Context & Initial Resources
    • Assignment: Project step P2a is due on 9-25
    • Reading: Lovett paper and Gomoll paper
      • Posts: Do two posts (total) on the Lovett and Gomoll papers.
  • 9-16 Discovering learning objectives (KCs) and Rational Cognitive Task Analysis
Multimedia Principles and Cognitive Task Analysis 9-18 to 10-16
  • 9-18 Multi-media Principle
    • Reading: 4.Multi-media Principle (24 pages)
      • Do the quiz and one post.
  • 9-23 Empirical CTA: Difficulty Factors Assessment (DFA)
    • Reading: Heffernan paper
      • Do two posts on the reading
    • Come with an attempt at a model of one your task solutions and, ideally, with an initial draft of project step 2a.
  • 9-25 Contiguity Principle
    • Reading: 5.Contiguity Principle (24 pages)
    • Due: P2a:Benchmark Tasks & Rational Cognitive Task Analysis
    • Class activity: Peer review of P2a
  • 9-30 From CTA to model building & instructional design
  • 10-2 Modality Principle
    • Reading: 6.Modality Principle (18 pages)
    • Class activity: Work on P2b. Analyzing your data
  • 10-9 Coherence Principle & Midterm Review
    • Reading: 8.Coherence Principle (28 pages)
    • Due: P2b: Empirical Cognitive Task Analysis & Cognitive Model of Instructional Goals
  • 10-14 Personalization Principle
    • Reading: 9.Personalization Principle (26 pages)
Learning By Doing Principles 10-21 to 11-18
  • 10-21 Segmenting and Pretraining
    • Reading: 10.Segmenting and Pretraining (18 pages)
    • Do quiz and one post
  • 10-23 KLI & Selecting appropriate instructional principles
    • Reading: KLI sections 6-7
    • DUE: P3a: Assessment & Initial Instructional Design
    • Assignment: P3b is due 11-6
  • 10-28 Leveraging Examples in E-Learning
    • Reading: 11.Leveraging Examples in E-Learning (28 pages)
  • 10-30 Does Practice Make Perfect
    • Reading: 12.Does Practice Make Perfect (28 pages)
  • 11-4 Learning Together Virtually
    • Reading: 13.Learning Together Virtually (30 pages)
  • 11-6 Who’s in Control?
    • Reading: 14.Who’s in Control? (30 pages)
  • 11-11 Simulations and Games
    • Reading: 16.Simulations and Games (32 pages)
    • DUE: P3b: Instructional Design Prototyping & Testing
    • Assignment: P4 is due 11-25
  • 11-13 E-Learning to Build Problem Solving Skill
    • Reading: 15.E-Learning to Build Problem Solving Skill (30 pages)
  • 11-18 Applying the Guidelines
    • Reading: 17.Applying the Guidelines (24 pages)
Project Presentations 11-20 to 12-4
  • 11-20 Project Presentations
  • 11-25 Project Presentations
    • Faculty course evaluation
    • DUE: P4: Research Design
    • Assignment: Final Project is due 12-12. It should include the reflection statement (see the project assignment handout).
  • 11-27 Thanksgiving, no class
  • 12-2 Project Presentations
  • 12-4 Project Presentations
Final Project Due on 12-12
  • 12-12 Project Due