Difference between revisions of "E-Learning Design Principles and Methods 2017"

From LearnLab
Jump to: navigation, search
(Created page with "====Course Details==== Course number: 05-823 Semester: Fall 2017 Carnegie Mellon University =====Class times===== 9:00 to 10:20 Tuesday & Thursday =====Location===== Gat...")
 
(Class Schedule in Brief)
 
(11 intermediate revisions by one other user not shown)
Line 32: Line 32:
  
 
=====Class URLs=====   
 
=====Class URLs=====   
For the syllabus go to [http://www.learnlab.org/research/wiki/index.php?title=E-Learning_Design_Principles_and_Methods_2016&redirect=no/ www.learnlab.org/research/wiki/index.php?title=E-Learning_Design_Principles_and_Methods_2016&redirect=no]
+
For the syllabus go to [http://www.learnlab.org/research/wiki/index.php/E-Learning_Design_Principles_and_Methods_2017 http://www.learnlab.org/research/wiki/index.php/E-Learning_Design_Principles_and_Methods_2017 ]
 +
 
  
 
For quizzes and reading reports go to [http://www.cmu.edu/blackboard/ www.cmu.edu/blackboard]
 
For quizzes and reading reports go to [http://www.cmu.edu/blackboard/ www.cmu.edu/blackboard]
Line 81: Line 82:
  
 
====Class Schedule in Brief====  
 
====Class Schedule in Brief====  
*E-Learning Introduction 8-30 to 9-1
+
*E-Learning Introduction 8-29 to 8-31
**Aug 30 Overview; Examples Assignment; Project; 1.E-learning (The "1." indicates this is a chapter in the Clark & Mayer book)
+
**Aug 29  Overview and e-learning Promises & Pitfalls (OLI Module 1); Examples Assignment; Project; 1.E-learning  
**Sept 1 2.How People Learn; Instructional complexities; Project topic brainstorming
+
**Aug 31      2.How People Learn; Instructional complexity (OLI Module 2)
*Instructional Goals and Assessment 9-6 to 9-15
+
*Backward Design: Goals and Assessment 9-5 to 9-14
**Sept 6 Determining instructional goals;  KLI KCs; Bloom's taxonomy
+
**Sept 5 Determining instructional goals;  KLI KCs; Bloom's taxonomy (OLI Module 3)
**Sept 8 Writing assessments to meet goals; Evidence-centered design
+
**Sept 7 Refining goals and Introduction to Designing Assessments (OLI Module 4)
**Sept 13 Why data toward goal setting improves design  
+
**Sept 12 Why data toward goal setting improves design; Contextual Inquiry principles (OLI Module 5)
**Sept 15 Online assessment; Practice e-assessment implementation
+
**Sept 14 Online assessment design and implementation (OLI Module 6)
*Cognitive Task Analysis (CTA) 9-20 to 9-29
+
*Cognitive Task Analysis (CTA) 9-20 to 9-28
**Sept 20 Empirical CTA: Structured Interviews
+
**Sept 19 Empirical CTA: Structured Interviews (OLI Module 7)
**Sept 22       Think Alouds & Rational CTA
+
**Sept 21       Think Alouds & Theoretical CTA (OLI Module 8)
**Sept 27 Quantitative Cognitive Task Analysis: Difficulty Factors Assessment
+
**Sept 26 Quantitative Cognitive Task Analysis: Difficulty Factors Assessment (OLI Module 9)
**Sept 29 Quantitative CTA via Data Mining
+
**Sept 28 Quantitative CTA via Data Mining (OLI Module 10)
*Learning By Doing Principles 10-4 to 10-25
+
*Learning By Doing Principles 10-3 to 10-24
**Oct     4 3.Evidence-based practice; KLI Learning & Instructional Events
+
**Oct   3 3.Evidence-based practice; KLI Learning & Instructional Events (OLI Module 11)
**Oct 6
+
**Oct 5 Practice, practice, practice (OLI Module 12)
**Oct 11 12.Does Practice Make Perfect; 14.Who’s in Control?
+
**Oct 10 12.Does Practice Make Perfect; 14.Who’s in Control? (OLI Module 13)
**Oct 13 15.E-Learning to Build Problem Solving Skill; 16.Simulations and Games
+
**Oct 12 15.E-Learning to Build Problem Solving Skill; 16.Simulations and Games (OLI Module 14)
**Oct 18 10.Segmenting and Pretraining; 11.Leveraging Examples in E-Learning
+
**Oct 17 10.Segmenting and Pretraining; 11.Leveraging Examples in E-Learning (OLI Module 15)
**Oct 20 KLI & Selecting appropriate instructional principles; Midterm review
+
**Oct 19 KLI & Selecting appropriate instructional principles; Midterm review
**Oct 25 Midterm exam  '''Bring laptop to class'''
+
**Oct 24 Midterm exam  '''Bring laptop to class'''
*Multimedia Principles 10-7 to 11-24
+
*Multimedia Principles 10-26 to 11-23
**Oct 27   [Guest topic: Options CSCL, Cognitive Mastery, Hint Factory, CTAT?]
+
**Oct 26   [Guest topic: Options CSCL, Cognitive Mastery, Hint Factory, CTAT?]
**Nov      1
+
**Oct  31
**Nov     3 4.Multimedia Principle; 5.Contiguity Principle; Practice applying
+
**Nov   2 4.Multimedia Principle; 5.Contiguity Principle; Practice applying (OLI Module 16)
**Nov       8    6.Modality Principle & 7.Redundancy Principle; Practice applying
+
**Nov   7        6.Modality Principle & 7.Redundancy Principle; Practice applying (OLI Module 17)
**Nov 10 8.Coherence Principle & 9.Personalization Principle; Practice applying  
+
**Nov 9 8.Coherence Principle & 9.Personalization Principle; Practice applying (OLI Module 18)
**Nov 15 17.Applying the Guidelines; KLI Review; Peer review of instructional design [too much on one day?]
+
*E-learning course design & evaluation 11-14 to 11-16
**Nov 17 In vivo experimentation; A/B Testing
+
**Nov 14 17.Applying the Guidelines; KLI Review (OLI Module 19)
**Nov 22 Flex topic; Presentation & Report Preparation
+
**Nov 16 In vivo experimentation; A/B Testing (OLI Module 20)
**Nov     24    Thanksgiving, no class
+
**Nov 21 Flex topic; Presentation & Report Preparation
*Final & Project Presentations 11-29 to 12-8
+
**Nov   23      Thanksgiving, no class
**Nov     29 Project Presentations
+
*Final & Project Presentations 11-28 to 12-7
**Dec      1 Project Presentations
+
**Nov   28 Project Presentations
**Dec 6 Project Presentations
+
**Nov  30 Project Presentations
**Dec 8 Final Exam '''Bring laptop to class'''
+
**Dec 5 Project Presentations
 +
**Dec 7 Final Exam '''Bring laptop to class'''
 
*Final Project due Dec 12
 
*Final Project due Dec 12
 
*If needed: Final Exam Make-up -TBD
 
*If needed: Final Exam Make-up -TBD
Line 124: Line 126:
 
'''NOTE:''' This section is "living" -- parts will evolve as I get a better sense of your needs.
 
'''NOTE:''' This section is "living" -- parts will evolve as I get a better sense of your needs.
  
=====E-Learning Introduction 8-30 to 9-1=====  
+
=====E-Learning Introduction 8-29 to 8-31=====  
  
*'''8-30''' ''Course Objectives & Course Project;  The boom in e-learning!''
+
*'''8-29''' ''Course Objectives & Course Project;  The boom in e-learning!''
 
**Reading (from course book): 1.e-Learning: Promise & Pitfalls (20 pages). [[Media:Ch1-4th_edition.pdf|This chapter is here  (click to get)]] but order the book right now!
 
**Reading (from course book): 1.e-Learning: Promise & Pitfalls (20 pages). [[Media:Ch1-4th_edition.pdf|This chapter is here  (click to get)]] but order the book right now!
 
***Pre-class quiz: Answer questions for Chpt1 Quiz on Blackboard Try to do this quiz before Tues class but it must be completed before Thurs class.
 
***Pre-class quiz: Answer questions for Chpt1 Quiz on Blackboard Try to do this quiz before Tues class but it must be completed before Thurs class.
Line 138: Line 140:
 
***a) Do the readings & b) associated flipped homework (See next date for reading assignment)
 
***a) Do the readings & b) associated flipped homework (See next date for reading assignment)
  
*'''9-1'''  ''How People Learn; Instructional complexities; Project topic brainstorming''
+
*'''8-31'''  ''How People Learn; Instructional complexities; Project topic brainstorming''
 
**Read Ch2. How Do People Learn from E-Courses (20 pages) [[Media:Ch2-4th_edition.pdf|You can get the chapter here this '''last''' time!]] ''Please order the book now if you have not!''
 
**Read Ch2. How Do People Learn from E-Courses (20 pages) [[Media:Ch2-4th_edition.pdf|You can get the chapter here this '''last''' time!]] ''Please order the book now if you have not!''
 
**Read Koedinger et al. (2013) paper  [[Media:Koedinger-Science-2013.pdf|Instructional complexities]]  
 
**Read Koedinger et al. (2013) paper  [[Media:Koedinger-Science-2013.pdf|Instructional complexities]]  
Line 148: Line 150:
 
***a) Do the readings & b) associated flipped homework
 
***a) Do the readings & b) associated flipped homework
  
=====Instructional Goals and Assessment 9-6 to 9-15=====  
+
=====Instructional Goals and Assessment 9-5 to 9-14=====  
  
*'''9-6''' ''Determining instructional goals; KLI KCs; Bloom's taxonomy''
+
*'''9-5''' ''Determining instructional goals; KLI KCs; Bloom's taxonomy''
 
**Reading: [[Media:CogInstCarver12.pdf|Carver paper]]
 
**Reading: [[Media:CogInstCarver12.pdf|Carver paper]]
 
**Reading: KLI sections 1-3 [[Media:KLI-Framework-KoedingerCorbettPerfetti2012.pdf|KLI Framework paper]] (we will discuss other sections later)
 
**Reading: KLI sections 1-3 [[Media:KLI-Framework-KoedingerCorbettPerfetti2012.pdf|KLI Framework paper]] (we will discuss other sections later)
Line 161: Line 163:
 
***We will find examples of promises & pitfalls, knowledge component types, etc.
 
***We will find examples of promises & pitfalls, knowledge component types, etc.
  
*'''9-8''' ''Writing assessments to meet goals''
+
*'''9-7''' ''Writing assessments to meet goals''
 
**Reading: [https://www.cmu.edu/teaching/assessment/index.html Assessment design--Eberly Center web pages on Assess Teaching and Learning] Read:  Basics, Prior Knowledge, Assessing Learning, Examples and Tools  (Skip:  Assessing Teaching, Assessing Programs, History at Carnegie Mellon)  
 
**Reading: [https://www.cmu.edu/teaching/assessment/index.html Assessment design--Eberly Center web pages on Assess Teaching and Learning] Read:  Basics, Prior Knowledge, Assessing Learning, Examples and Tools  (Skip:  Assessing Teaching, Assessing Programs, History at Carnegie Mellon)  
 
***Do Discussion Board post on reading.
 
***Do Discussion Board post on reading.
 
**Class activity: Goal setting & designing assessments that provide evidence of goal achievement
 
**Class activity: Goal setting & designing assessments that provide evidence of goal achievement
  
*'''9-13''' ''Why data toward goal setting improves design''
+
*'''9-12''' ''Why data toward goal setting improves design''
 
**Reading: [[Media:Feldon_Timmerman_etal_2010.pdf | Feldon paper]]
 
**Reading: [[Media:Feldon_Timmerman_etal_2010.pdf | Feldon paper]]
 
**At least skim: [[Media:Clark_CTA_In_Healthcare_Chapter_2012.pdf | Clark_CTA_In_Healthcare_Chapter_2012]]
 
**At least skim: [[Media:Clark_CTA_In_Healthcare_Chapter_2012.pdf | Clark_CTA_In_Healthcare_Chapter_2012]]
Line 174: Line 176:
 
**Class activity: Interviewing practice
 
**Class activity: Interviewing practice
  
*'''9-15''' ''Online assessment; Practice e-assessment implementation''
+
*'''9-14''' ''Online assessment; Practice e-assessment implementation''
 
**Reading: Read the documentation for two online assessment authoring tools of your choosing
 
**Reading: Read the documentation for two online assessment authoring tools of your choosing
 
***Discussion board posts on pros and cons of the tools you read about
 
***Discussion board posts on pros and cons of the tools you read about
 
**Class activity: BRING YOUR LAPTOP and be prepared to use an online assessment development tool
 
**Class activity: BRING YOUR LAPTOP and be prepared to use an online assessment development tool
 
**DUE: P1: Context & Initial Resources    '''(Submit all project steps as a shared google doc or in Blackboard as a Word doc. Do not submit a pdf.)'''  
 
**DUE: P1: Context & Initial Resources    '''(Submit all project steps as a shared google doc or in Blackboard as a Word doc. Do not submit a pdf.)'''  
**Assignment: P2 is due Sept 29
+
**Assignment: P2 is due Sept 28
  
=====Cognitive Task Analysis (CTA) 9-20 to 9-29=====
+
=====Cognitive Task Analysis (CTA) 9-19 to 9-28=====
*'''9-20''' ''Empirical CTA: Structured Interviews''  
+
*'''9-19''' ''Empirical CTA: Structured Interviews''  
 
**Reading: [[Media:Clarketal2007-CTAchapter proof-1.pdf | Clark et al., 2007 Chapter proof]]   
 
**Reading: [[Media:Clarketal2007-CTAchapter proof-1.pdf | Clark et al., 2007 Chapter proof]]   
 
**Reading: [[Media:Contextual Inquiry Practice.pdf|Contextual inquiry in practice]]
 
**Reading: [[Media:Contextual Inquiry Practice.pdf|Contextual inquiry in practice]]
Line 189: Line 191:
 
***Do posts for readings.
 
***Do posts for readings.
  
*'''9-22''' ''Think Alouds & Rational CTA''
+
*'''9-21''' ''Think Alouds & Rational CTA''
 
**Reading: [[Media:Lovett98.pdf|Lovett paper]] and [[Media:Gomoll-90.pdf|Gomoll paper]] -- [[Media:L05_Think_Aloud_2014-Lovett-Gomoll-for_syllabus.pptx|Slides]]
 
**Reading: [[Media:Lovett98.pdf|Lovett paper]] and [[Media:Gomoll-90.pdf|Gomoll paper]] -- [[Media:L05_Think_Aloud_2014-Lovett-Gomoll-for_syllabus.pptx|Slides]]
 
**Reading: [[Media:Zhu&Simon-1987.pdf|Zhu & Simon paper]] -- [[Media:L06-ELDP-Rational-CTA-2014-b-for_syllabus.pptx|Slides]]
 
**Reading: [[Media:Zhu&Simon-1987.pdf|Zhu & Simon paper]] -- [[Media:L06-ELDP-Rational-CTA-2014-b-for_syllabus.pptx|Slides]]
 
***Do quizzes for the readings.
 
***Do quizzes for the readings.
  
*'''9-27''' ''Quantitative Cognitive Task Analysis: Difficulty Factors Assessment''  
+
*'''9-26''' ''Quantitative Cognitive Task Analysis: Difficulty Factors Assessment''  
 
**Reading: [[Media:CogSci97-Heffernan-distrib.pdf‎ | Heffernan paper]] -- [[Media:L08-ELDP-CTA-DFA-2014-Heffernan_forsyllabus.pptx|Slides]]
 
**Reading: [[Media:CogSci97-Heffernan-distrib.pdf‎ | Heffernan paper]] -- [[Media:L08-ELDP-CTA-DFA-2014-Heffernan_forsyllabus.pptx|Slides]]
 
**Come with an initial draft of project step 2.
 
**Come with an initial draft of project step 2.
 
***Do quiz for Heffernan paper.  
 
***Do quiz for Heffernan paper.  
  
*'''9-29''' ''Quantitative CTA via Data Mining; CTA to improve instructional design''
+
*'''9-28''' ''Quantitative CTA via Data Mining; CTA to improve instructional design''
 
**Class activity: Peer review of P2  
 
**Class activity: Peer review of P2  
 
**Reading: [[Media:Koedinger-et-al-aied2013.pdf | e-learning data to improvement]] (10 pages)
 
**Reading: [[Media:Koedinger-et-al-aied2013.pdf | e-learning data to improvement]] (10 pages)
 
***Do quiz for e-learning data to improvement paper
 
***Do quiz for e-learning data to improvement paper
 
**DUE: P2: Identifying Goals & Online Assessment Creation  
 
**DUE: P2: Identifying Goals & Online Assessment Creation  
**Assignment: P3 is due Oct 13
+
**Assignment: P3 is due Oct 12
  
=====Learning By Doing Principles 10-4 to 10-25 =====  
+
=====Learning By Doing Principles 10-3 to 10-24 =====  
*'''10-4''' ''Evidence-based practice; KLI Learning & Instructional Events''
+
*'''10-3''' ''Evidence-based practice; KLI Learning & Instructional Events''
 
**Reading: Clark & Mayer book Ch3.Evidence-based practice (18 pages)  [[Media:L03-ELDP-evidence-KLI-2014.pptx|Slides]]
 
**Reading: Clark & Mayer book Ch3.Evidence-based practice (18 pages)  [[Media:L03-ELDP-evidence-KLI-2014.pptx|Slides]]
 
**Reading: KLI paper sections 4-5 (12 pages)
 
**Reading: KLI paper sections 4-5 (12 pages)
 
*** Do quizzes for the readings.
 
*** Do quizzes for the readings.
  
*'''10-6''' ''Practice, practice, practice''
+
*'''10-5''' ''Practice, practice, practice''
 
**Reading:  [[Media:Make_It_Stick_Ch1-2.pdf|Make It Stick Ch 1 and Ch 2 (45 pages) ]]
 
**Reading:  [[Media:Make_It_Stick_Ch1-2.pdf|Make It Stick Ch 1 and Ch 2 (45 pages) ]]
 
**Recommended reading: [[Media:Visible_Learning_Ch_9.pdf|Visible Learning Ch 9 (38 pages) ]]
 
**Recommended reading: [[Media:Visible_Learning_Ch_9.pdf|Visible Learning Ch 9 (38 pages) ]]
Line 219: Line 221:
 
*** Do posts for the readings.
 
*** Do posts for the readings.
  
*'''10-11''' ''Does Practice Make Perfect; Who’s in Control?''
+
*'''10-10''' ''Does Practice Make Perfect; Who’s in Control?''
 
**Reading: 12.Does Practice Make Perfect (28 pages)  [[Media:L18-ELDP-Practice-2014-for_syllabus.pptx|Slides]]
 
**Reading: 12.Does Practice Make Perfect (28 pages)  [[Media:L18-ELDP-Practice-2014-for_syllabus.pptx|Slides]]
 
**Reading: 14.Who’s in Control? (30 pages)  [[Media:Principles_e-learning_14.pdf |Slides]]  
 
**Reading: 14.Who’s in Control? (30 pages)  [[Media:Principles_e-learning_14.pdf |Slides]]  
 
***Do quizzes for the readings.
 
***Do quizzes for the readings.
  
*'''10-13''' ''E-Learning to Build Problem Solving Skill; Simulations and Games''  
+
*'''10-12''' ''E-Learning to Build Problem Solving Skill; Simulations and Games''  
 
**Reading: 15.E-Learning to Build Problem Solving Skill (30 pages)  [[Media:L22-ELDP-ThinkingSkills-2014-for_syllabus.pptx|Slides]]  
 
**Reading: 15.E-Learning to Build Problem Solving Skill (30 pages)  [[Media:L22-ELDP-ThinkingSkills-2014-for_syllabus.pptx|Slides]]  
 
**Reading: 16.Simulations and Games (32 pages)    [[Media:L23-ELDP-GamesSimulations-2014_for_syllabus.pptx|Slides]]  
 
**Reading: 16.Simulations and Games (32 pages)    [[Media:L23-ELDP-GamesSimulations-2014_for_syllabus.pptx|Slides]]  
Line 231: Line 233:
 
**Assignment: P4 is due Oct 31
 
**Assignment: P4 is due Oct 31
  
*'''10-18''' ''Segmenting and Pretraining; Leveraging Examples in E-Learning''  
+
*'''10-17''' ''Segmenting and Pretraining; Leveraging Examples in E-Learning''  
 
**Reading: 10.Segmenting and Pretraining (18 pages)  [[Media:L16-ELDP-Segmenting-Pretraining-2014-for syllabus.pptx|Slides]]
 
**Reading: 10.Segmenting and Pretraining (18 pages)  [[Media:L16-ELDP-Segmenting-Pretraining-2014-for syllabus.pptx|Slides]]
 
**Reading: 11.Leveraging Examples in E-Learning (28 pages)  [[Media:L17-ELDP-Worked-Examples-2014-for_syllabus.pptx|Slides]]  
 
**Reading: 11.Leveraging Examples in E-Learning (28 pages)  [[Media:L17-ELDP-Worked-Examples-2014-for_syllabus.pptx|Slides]]  
 
***Do quizzes for the readings.
 
***Do quizzes for the readings.
  
*'''10-20''' ''Midterm review''  
+
*'''10-19''' ''Midterm review''  
 
**Do review quiz and bring questions to class
 
**Do review quiz and bring questions to class
 
**No new post or quiz.
 
**No new post or quiz.
Line 243: Line 245:
 
***[http://www.articulate.com/rapid-elearning/visual-graphic-design/ Visual & Graphic Design for e-learning blog]
 
***[http://www.articulate.com/rapid-elearning/visual-graphic-design/ Visual & Graphic Design for e-learning blog]
  
*'''10-25''' ''Midterm exam'' '''Bring laptop to class'''
+
*'''10-24''' ''Midterm exam'' '''Bring laptop to class'''
  
=====Multimedia Principles 10-27 to 11-8=====  
+
=====Multimedia Principles 10-26 to 11-7=====  
*'''10-27''' ''Optional topic''
+
*'''10-26''' ''Optional topic''
 
**E-Learning in Industry
 
**E-Learning in Industry
 
**Work on project
 
**Work on project
**DUE Mon, 10/31 by 12 noon: P4: Initial Instructional Design  
+
**DUE Mon, 10/30 by 12 noon: P4: Initial Instructional Design  
**Assignment: P5 is due 11-17
+
**Assignment: P5 is due 11-16
  
*'''11-1''' ''Multimedia Principle; Contiguity Principle; Practice applying''
+
*'''10-31''' ''Multimedia Principle; Contiguity Principle; Practice applying''
 
**Reading: 4.Multimedia Principle (24 pages) [[Media:L07-ELDP-Multimedia-2014_for_syllabus.pptx|Slides]]  
 
**Reading: 4.Multimedia Principle (24 pages) [[Media:L07-ELDP-Multimedia-2014_for_syllabus.pptx|Slides]]  
 
**Reading: 5.Contiguity Principle (24 pages)  [[Media:Contiguity2014.pptx|Slides]]
 
**Reading: 5.Contiguity Principle (24 pages)  [[Media:Contiguity2014.pptx|Slides]]
Line 263: Line 265:
 
***Why Some Material is Difficult to Learn [[Media:Sweller Chandler Why Some Material is Difficult to Learn.pdf |Paper]] [[Media:SwellerChandler1994.pptx|Slides]]
 
***Why Some Material is Difficult to Learn [[Media:Sweller Chandler Why Some Material is Difficult to Learn.pdf |Paper]] [[Media:SwellerChandler1994.pptx|Slides]]
  
*'''11-3''' ''Modality Principle & Redundancy Principle; Practice applying''
+
*'''11-2''' ''Modality Principle & Redundancy Principle; Practice applying''
 
**Reading: 6.Modality Principle (18 pages)    [[Media:Modality-2014-1.pptx |Slides]]
 
**Reading: 6.Modality Principle (18 pages)    [[Media:Modality-2014-1.pptx |Slides]]
 
**Reading: 7.Redundancy Principle (18 pages)  [[Media:L12-ELDP-Redundancy&eData-2014.pptx|Slides]]
 
**Reading: 7.Redundancy Principle (18 pages)  [[Media:L12-ELDP-Redundancy&eData-2014.pptx|Slides]]
 
***Do quizzes for the readings.
 
***Do quizzes for the readings.
  
*'''11-8''' ''Coherence Principle & Personalization Principle; Practice applying''  
+
*'''11-7''' ''Coherence Principle & Personalization Principle; Practice applying''  
 
**Reading: 8.Coherence Principle (28 pages)  [[Media:L12-ELDP-Coherence-2014.pptx|Slides]]  
 
**Reading: 8.Coherence Principle (28 pages)  [[Media:L12-ELDP-Coherence-2014.pptx|Slides]]  
 
**Reading: 9.Personalization Principle (26 pages)  [[Media:L14-ELDP-Personalization-2014.pptx|Slides]]  
 
**Reading: 9.Personalization Principle (26 pages)  [[Media:L14-ELDP-Personalization-2014.pptx|Slides]]  
 
***Do quizzes for the readings.
 
***Do quizzes for the readings.
  
=====Putting it together & evaluation 11-10 to 11-24=====  
+
=====Putting it together & evaluation 11-9 to 11-23=====  
  
*'''11-10''' ''Applying the Guidelines; KLI & Selecting appropriate instructional principles''
+
*'''11-9''' ''Applying the Guidelines; KLI & Selecting appropriate instructional principles''
 
**Reading: 17.Applying the Guidelines (24 pages)  [[Media:L25-ELDPCh17-Guidelines-KLIreview-2014.pptx|Slides]]  
 
**Reading: 17.Applying the Guidelines (24 pages)  [[Media:L25-ELDPCh17-Guidelines-KLIreview-2014.pptx|Slides]]  
 
**Reading: KLI sections 6-7  [[Media:L17-ELDP-KLI-selecting-principles-for syllabus.pptx|Slides]]
 
**Reading: KLI sections 6-7  [[Media:L17-ELDP-KLI-selecting-principles-for syllabus.pptx|Slides]]
Line 281: Line 283:
 
** Time permitting: Peer review of instructional design
 
** Time permitting: Peer review of instructional design
  
*'''11-15''' ''In vivo experimentation; A/B Testing''
+
*'''11-14''' ''In vivo experimentation; A/B Testing''
 
**DUE: P5: Instructional Design Prototyping & Testing  
 
**DUE: P5: Instructional Design Prototyping & Testing  
**Assignment: P6 is due 11-29
+
**Assignment: P6 is due 11-28
  
*'''11-17''' ''Finish discussion of experimentation''  
+
*'''11-16''' ''Finish discussion of experimentation''  
  
*'''11-22''' ''Flex topic; Presentation & Report Preparation''
+
*'''11-21''' ''Flex topic; Presentation & Report Preparation''
  
*'''11-24'''  ''Thanksgiving, no class''
+
*'''11-23'''  ''Thanksgiving, no class''
  
=====Final & Project Presentations 11-29 to 12-18=====  
+
=====Final & Project Presentations 11-28 to 12-7=====  
  
*'''11-29''' ''Project Presentations''
+
*'''11-28''' ''Project Presentations''
 
** DUE: P6: Experimental Design
 
** DUE: P6: Experimental Design
 
**Assignment: Final Project is due 12-12. It should include the reflection statement (see the project assignment handout).  
 
**Assignment: Final Project is due 12-12. It should include the reflection statement (see the project assignment handout).  
*'''12-1''' ''Project Presentations''
+
*'''11-30''' ''Project Presentations''
*'''12-6''' ''Project Presentations''
+
*'''12-5''' ''Project Presentations''
*'''12-8''' Final Exam '''Bring laptop to class'''
+
*'''12-7''' Final Exam '''Bring laptop to class'''
 
**If needed: Final Exam Make-up - TBD
 
**If needed: Final Exam Make-up - TBD
  
 
====='''Final Project Due  12-12'''=====
 
====='''Final Project Due  12-12'''=====

Latest revision as of 14:30, 24 August 2017

Course Details

Course number: 05-823

Semester: Fall 2017

Carnegie Mellon University

Class times

9:00 to 10:20 Tuesday & Thursday

Location

Gates Hillman Center (GHC) Room 4301

Instructor

Professor Ken Koedinger

Office: 3601 Newell-Simon Hall, Phone: 412-268-7667

Email: Koedinger@cmu.edu, Office hours by appointment

Teaching assistant: Mimi McLaughlin Email: mimim@cs.cmu.edu

Administrative assistant: Jo Bodnar Email: jobodnar@cs.cmu.edu

Course Prerequisites

To enroll you must either be in the Masters of Educational Technology and Applied Learning Science (METALS) or get the permission of the instructor.

Textbook and Readings

"E-Learning and the Science of Instruction: 4th edition" by Ruth Colvin Clark and Richard E. Mayer.

Other readings will be assigned in class. See below.

Class URLs

For the syllabus go to http://www.learnlab.org/research/wiki/index.php/E-Learning_Design_Principles_and_Methods_2017


For quizzes and reading reports go to www.cmu.edu/blackboard

Goals

This course is about e-learning design principles, the evidence and theory behind them, and how to apply these principles to develop effective educational technologies. It is organized around the book "e-Learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning" by Clark & Mayer with further readings drawn from cognitive science, educational psychology, and human-computer interaction. You will learn design principles 1) for combining words, audio, and graphics in multimedia instruction, 2) for combining examples, explanations, practice and feedback in online support for learning by doing, and 3) for balancing learner versus system control and supporting student metacognition. You will read about the experiments that support these design principles, see examples of how to design such experiments, and practice applying the principles in your own educational technology design project.

Flipped Homework: Reading Quizzes and Reading Reports

You will have "flipped homework", a variation on the flipped classroom idea you might have heard of. Flipped homework is an assignment before a relevant class meeting rather than after it. It helps you to check your understanding of what you read, to practice to enhance your memory (we will talk about the "testing effect" in class), and to get a better sense of what you don't know so you are prepared to ask questions in class. It also helps instructors focus the class discussion to better avoid belaboring known points and pursue student needs and interests.

Before some class sessions, you will asked to do a quiz associated with the assigned book chapter. The quizzes will be on the Blackboard site (www.cmu.edu/blackboard, the course is listed as "Special Topics in HCI"). Before other class sessions, you will be asked to write "reading reports". We will use the discussion board on Blackboard. You should complete assigned quizzes or reading reports before 8am on the day of class. Quizzes can be taken as many times as you want and your score will be the last attempt before 8am.

For reading reports, the discussion forum post will usually direct you as to how to reply. If not otherwise directed, you should make two posts on the readings. Your two posts may be original or in response to another post (one of both is nice).

  • Original posts should contain one or more of the following:
    • something you learned from the reading or slides
    • a question you have about the reading or slides or about the topic in general
    • a connection with something you learned or did previously in this or another course, or in other professional work or research
  • Replies should be an on-topic, relevant response, clarification, or further comment on another student’s post.

In general, please come to class prepared to ask questions and give answers.

Laptop Policy (updated 8/30/16)

Given that class discussion is a major part of the course, you should only use laptops, cell phones, and smart phones when you are directed to do so or within the common note taking Google page that I will provide. Deviation form this policy will result in a reduction in your participation grade. You will often need or want a laptop or smart device. You will definitely need one during testing days (marked as such on the schedule).

If interested in what educational research says about laptop use in class, or multi-tasking more generally, you might look at (available on the course BlackBoard):

  • Fried, C. B. (2008). In-class laptop use and its effects on student learning. Computers & Education, 50, 906–914.
  • Kirschner, P. A., & Merriënboer, J. J. V. (2013). Do learners really know best? Urban legends in education. Educational Psychologist, 48(3), 169–183. doi:10.1080/00461520.2013.80439
  • Kraushaar, J. M., & Novak, D. C. (2010). Examining the affects [sic] of student multitasking with laptops during the lecture. Journal of Information Systems Education, 21(2), 241-251.
  • Wood, E., Zivcakova, L., Gentile, P., Archer, K., De Pasquale, D., & Nosko, A. (2012). Examining the impact of off-task multi-tasking with technology on real-time classroom learning. Computers & Education, 58(1), 365-374. doi:10.1016/j.compedu.2011.08.02

Grading

  • 35% Final Project Project assignment (Submit project steps preferably as a Google document (provide access by sharing with the instructor and TA), but a Word document is OK. Do not submit a pdf.)
    • Six parts of final project
    • Final project submission
  • 5% E-Learning examples assignment
  • 15% Midterm exam
  • 15% Pre-class quizzes & reading reports
  • 15% Final Exam
  • 15% Class participation, including reading summary presentations

Class Schedule in Brief

  • E-Learning Introduction 8-29 to 8-31
    • Aug 29 Overview and e-learning Promises & Pitfalls (OLI Module 1); Examples Assignment; Project; 1.E-learning
    • Aug 31 2.How People Learn; Instructional complexity (OLI Module 2)
  • Backward Design: Goals and Assessment 9-5 to 9-14
    • Sept 5 Determining instructional goals; KLI KCs; Bloom's taxonomy (OLI Module 3)
    • Sept 7 Refining goals and Introduction to Designing Assessments (OLI Module 4)
    • Sept 12 Why data toward goal setting improves design; Contextual Inquiry principles (OLI Module 5)
    • Sept 14 Online assessment design and implementation (OLI Module 6)
  • Cognitive Task Analysis (CTA) 9-20 to 9-28
    • Sept 19 Empirical CTA: Structured Interviews (OLI Module 7)
    • Sept 21 Think Alouds & Theoretical CTA (OLI Module 8)
    • Sept 26 Quantitative Cognitive Task Analysis: Difficulty Factors Assessment (OLI Module 9)
    • Sept 28 Quantitative CTA via Data Mining (OLI Module 10)
  • Learning By Doing Principles 10-3 to 10-24
    • Oct 3 3.Evidence-based practice; KLI Learning & Instructional Events (OLI Module 11)
    • Oct 5 Practice, practice, practice (OLI Module 12)
    • Oct 10 12.Does Practice Make Perfect; 14.Who’s in Control? (OLI Module 13)
    • Oct 12 15.E-Learning to Build Problem Solving Skill; 16.Simulations and Games (OLI Module 14)
    • Oct 17 10.Segmenting and Pretraining; 11.Leveraging Examples in E-Learning (OLI Module 15)
    • Oct 19 KLI & Selecting appropriate instructional principles; Midterm review
    • Oct 24 Midterm exam Bring laptop to class
  • Multimedia Principles 10-26 to 11-23
    • Oct 26 [Guest topic: Options CSCL, Cognitive Mastery, Hint Factory, CTAT?]
    • Oct 31
    • Nov 2 4.Multimedia Principle; 5.Contiguity Principle; Practice applying (OLI Module 16)
    • Nov 7 6.Modality Principle & 7.Redundancy Principle; Practice applying (OLI Module 17)
    • Nov 9 8.Coherence Principle & 9.Personalization Principle; Practice applying (OLI Module 18)
  • E-learning course design & evaluation 11-14 to 11-16
    • Nov 14 17.Applying the Guidelines; KLI Review (OLI Module 19)
    • Nov 16 In vivo experimentation; A/B Testing (OLI Module 20)
    • Nov 21 Flex topic; Presentation & Report Preparation
    • Nov 23 Thanksgiving, no class
  • Final & Project Presentations 11-28 to 12-7
    • Nov 28 Project Presentations
    • Nov 30 Project Presentations
    • Dec 5 Project Presentations
    • Dec 7 Final Exam Bring laptop to class
  • Final Project due Dec 12
  • If needed: Final Exam Make-up -TBD

Class Schedule with Readings and Assignments

NOTE: This section is "living" -- parts will evolve as I get a better sense of your needs.

E-Learning Introduction 8-29 to 8-31
  • 8-29 Course Objectives & Course Project; The boom in e-learning!
    • Reading (from course book): 1.e-Learning: Promise & Pitfalls (20 pages). This chapter is here (click to get) but order the book right now!
      • Pre-class quiz: Answer questions for Chpt1 Quiz on Blackboard Try to do this quiz before Tues class but it must be completed before Thurs class.
      • Slides for this chapter are here.
    • Class activity: Introduce your background and interests in e-learning
    • Assignment: Examples assignment is due next Mon, Sept 4. Please submit on blackboard.
    • Assignment: Project step 1 is due in 16 days on Thursday, 9-14
    • For next time:
      • BRING two screen shots of an e-learning example to next class
      • Review project step 1 and come with a preliminary project idea.
      • a) Do the readings & b) associated flipped homework (See next date for reading assignment)
  • 8-31 How People Learn; Instructional complexities; Project topic brainstorming
    • Read Ch2. How Do People Learn from E-Courses (20 pages) You can get the chapter here this last time! Please order the book now if you have not!
    • Read Koedinger et al. (2013) paper Instructional complexities
      • Do the quiz for Chapter 2 (Quiz 2).
      • On Blackboard do a "Discussion Board" post for Instructional complexities paper within the forum titled "Instructional Complexity Reading Posts for 8-31"
    • Class activity: Project idea discussion
      • Be ready to discuss some of your preliminary project ideas -- enter these in Google Doc of class notes
    • For next time:
      • a) Do the readings & b) associated flipped homework
Instructional Goals and Assessment 9-5 to 9-14
  • 9-5 Determining instructional goals; KLI KCs; Bloom's taxonomy
    • Reading: Carver paper
    • Reading: KLI sections 1-3 KLI Framework paper (we will discuss other sections later)
    • Additional Reading: Bloom's taxonomy revised
      • Do Discussion Board post on Carver paper.
      • Do quiz for the KLI reading.
    • Class activity: Review Project ideas and step 1 write-up requirements
    • Class activity: Review of e-learning examples
      • BRING a print-out of your e-learning examples to class
      • We will find examples of promises & pitfalls, knowledge component types, etc.
  • 9-7 Writing assessments to meet goals
  • 9-14 Online assessment; Practice e-assessment implementation
    • Reading: Read the documentation for two online assessment authoring tools of your choosing
      • Discussion board posts on pros and cons of the tools you read about
    • Class activity: BRING YOUR LAPTOP and be prepared to use an online assessment development tool
    • DUE: P1: Context & Initial Resources (Submit all project steps as a shared google doc or in Blackboard as a Word doc. Do not submit a pdf.)
    • Assignment: P2 is due Sept 28
Cognitive Task Analysis (CTA) 9-19 to 9-28
  • 9-26 Quantitative Cognitive Task Analysis: Difficulty Factors Assessment
  • 9-28 Quantitative CTA via Data Mining; CTA to improve instructional design
    • Class activity: Peer review of P2
    • Reading: e-learning data to improvement (10 pages)
      • Do quiz for e-learning data to improvement paper
    • DUE: P2: Identifying Goals & Online Assessment Creation
    • Assignment: P3 is due Oct 12
Learning By Doing Principles 10-3 to 10-24
  • 10-3 Evidence-based practice; KLI Learning & Instructional Events
    • Reading: Clark & Mayer book Ch3.Evidence-based practice (18 pages) Slides
    • Reading: KLI paper sections 4-5 (12 pages)
      • Do quizzes for the readings.
  • 10-10 Does Practice Make Perfect; Who’s in Control?
    • Reading: 12.Does Practice Make Perfect (28 pages) Slides
    • Reading: 14.Who’s in Control? (30 pages) Slides
      • Do quizzes for the readings.
  • 10-12 E-Learning to Build Problem Solving Skill; Simulations and Games
    • Reading: 15.E-Learning to Build Problem Solving Skill (30 pages) Slides
    • Reading: 16.Simulations and Games (32 pages) Slides
      • Do quizzes for the readings.
    • DUE: P3: Cognitive Task Analysis & Cognitive Model
    • Assignment: P4 is due Oct 31
  • 10-17 Segmenting and Pretraining; Leveraging Examples in E-Learning
    • Reading: 10.Segmenting and Pretraining (18 pages) Slides
    • Reading: 11.Leveraging Examples in E-Learning (28 pages) Slides
      • Do quizzes for the readings.
  • 10-24 Midterm exam Bring laptop to class
Multimedia Principles 10-26 to 11-7
  • 10-26 Optional topic
    • E-Learning in Industry
    • Work on project
    • DUE Mon, 10/30 by 12 noon: P4: Initial Instructional Design
    • Assignment: P5 is due 11-16
  • 10-31 Multimedia Principle; Contiguity Principle; Practice applying
    • Reading: 4.Multimedia Principle (24 pages) Slides
    • Reading: 5.Contiguity Principle (24 pages) Slides
      • Do quizzes for the readings.
    • Optional readings & slides about the multimedia principle:
      • Systematic Thinking Fostered by Illustrations in Scientific Text Paper Slides
      • Multimedia-Supported Metaphors for Meaning Making in Mathematics Paper Slides
    • Optional readings & slides about the Contiguity principle:
      • Cognitive Principles of Multimedia Learning: The Role of Modality and Contiguity Paper Slides
      • Why Some Material is Difficult to Learn Paper Slides
  • 11-2 Modality Principle & Redundancy Principle; Practice applying
    • Reading: 6.Modality Principle (18 pages) Slides
    • Reading: 7.Redundancy Principle (18 pages) Slides
      • Do quizzes for the readings.
  • 11-7 Coherence Principle & Personalization Principle; Practice applying
    • Reading: 8.Coherence Principle (28 pages) Slides
    • Reading: 9.Personalization Principle (26 pages) Slides
      • Do quizzes for the readings.
Putting it together & evaluation 11-9 to 11-23
  • 11-9 Applying the Guidelines; KLI & Selecting appropriate instructional principles
    • Reading: 17.Applying the Guidelines (24 pages) Slides
    • Reading: KLI sections 6-7 Slides
      • Do posts for the reading.
    • Time permitting: Peer review of instructional design
  • 11-14 In vivo experimentation; A/B Testing
    • DUE: P5: Instructional Design Prototyping & Testing
    • Assignment: P6 is due 11-28
  • 11-16 Finish discussion of experimentation
  • 11-21 Flex topic; Presentation & Report Preparation
  • 11-23 Thanksgiving, no class
Final & Project Presentations 11-28 to 12-7
  • 11-28 Project Presentations
    • DUE: P6: Experimental Design
    • Assignment: Final Project is due 12-12. It should include the reflection statement (see the project assignment handout).
  • 11-30 Project Presentations
  • 12-5 Project Presentations
  • 12-7 Final Exam Bring laptop to class
    • If needed: Final Exam Make-up - TBD
Final Project Due 12-12