Enhancing Learning through Computer Animation - Revision history

Corbett at 20:55, 19 May 2009

2009-05-19T20:55:02Z

← Older revision		Revision as of 20:55, 19 May 2009
Line 33:		Line 33:

	===Planned experiments===		===Planned experiments===
	* ~~Lab study (2 phases):~~		*
	**(1) A two-condition study (comparing the baseline tutor to the modified tutor with all five improvements) testing overall student learning (including measures of robust learning) and efficiency in one tutor unit (Angles).		**
	**(2) Think-aloud (lab) research to determine if worked-examples and visual interaction have the hypothesized, complementary process effects.
	* In vivo study: A two-condition in-vivo study (comparing the baseline tutor to the modified tutor with all four improvements). Measures of learning gains and learning efficiency (time taken to complete tutor) will be utilized.

	=== Hypotheses ===		=== Hypotheses ===

Corbett at 20:53, 19 May 2009

2009-05-19T20:53:22Z

← Older revision		Revision as of 20:53, 19 May 2009
Line 22:		Line 22:
	\|}		\|}
	=== Abstract ===		=== Abstract ===
	~~The main idea~~ in ~~the current project is~~ to ~~combine~~ instructional ~~interventions derived from five instructional principles~~. ~~Each~~ of ~~these interventions has been shown to be effective~~ in ~~separate~~ (~~PSLC~~) ~~studies~~, ~~and can be expected~~ on ~~theoretical grounds~~ to ~~be synergistic~~ (~~or complementary~~). ~~We hypothesize that~~ instruction ~~that simultaneously implements several principles will be dramatically more effective than instruction that does not implement any~~ of the ~~targeted principles~~ (~~e.g. current common practice~~). This ~~project~~ will ~~test this hypothesis, focusing on~~ the ~~following five principles:~~		This project investigates the possible combined strengths of graphically-oriented (Animation Tutor) and procedurally-oriented (Cognitive Tutor) instructional software. Students in Algebra II Cognitive Tutor classrooms are randomly assigned to one of four instructional groups on constructing equations for mixture problems. Three of the instructional groups study worked examples in which they received a verbal explanation of the solution with quantities represented by either (1) a table of values, (2) a static bar graph, or (3) a dynamic bar graph linked to the equation. The fourth group solve the same example problems using the Algebra Cognitive Tutor.
			Each of the example problems are followed by a test problem on the Algebra Cognitive Tutor that serves to both evaluate the different instructional conditions and provide additional opportunities for learning. Students enter quantities into a table and use these quantities (following feedback) to construct an equation to represent the problem. Two days of instruction are followed a week later, by (1) a Model Analysis Cognitive Tutor activity in which students are tested (with feedback) on their ability to construct equations for different problem structures and interpret the meaning of the terms in the equations; and (2) a paper-and-pencil test to measure retention and transfer. This variety of evaluation measures will help in identify how the different instructional formats help students learn the various knowledge components needed to construct equations for problems represented by general linear models.

	~~• Visual-verbal integration principle~~		An extended summary of the study design is in this pdf ...[[Media:ReedHoffmanCorbettWorkExSummary.pdf]]
	~~• Worked example principle~~
	~~• Prompted self-explanation principle~~
	~~• Accurate knowledge decomposition principle~~
	~~(part of the complete and efficient practice principle)~~
	~~• Accurate knowledge estimates principle~~
	~~(part of the complete and efficient practice principle)~~

	Building on our prior work that tested these principles individually, we will create a new version of the Geometry Cognitive Tutor that implements these five principles. We will use this new version to conduct both a lab experiment and an in vivo experiment to test the hypothesis that the combination of these principles produces a large effect size compared to the standard Cognitive Tutor.
	Knowing which instructional interventions and principles are synergistic (as well as when interventions and principles do not have any additive effects) is an important practical and theoretical goal within the learning sciences. This project will contribute new knowledge to our understanding of the relationship between instructional principles for robust learning. From a practical perspective, instructional designers often use principles in combination (e.g. Anderson et al, 1995; Quintana et al, 2004); knowing which combinations are effective in concert is therefore pragmatically useful. Further, the project, if successful, will demonstrate that the studied combination of principles leads to dramatically greater effectiveness of one particular intelligent tutoring system. Since these principles are drawn from PSLC theory and research evidence, the successful combination of principles has important implications for the development of PSLC theory, and inference about its eventual impact on learning outcomes. From a theoretical perspective, individual instructional design principles are a convenient way of stating theory; findings related to synergy (or lack thereof) of individual principles impose constraints on the theoretical rationale of each. Thus, this project contributes to both the applied and the theoretical missions of the PSLC.

	~~A summary of the project~~ is in this pdf ...[[Media:ReedHoffmanCorbettWorkExSummary.pdf]]

	=== Background & Significance ===		=== Background & Significance ===

Corbett at 20:41, 19 May 2009

2009-05-19T20:41:12Z

← Older revision		Revision as of 20:41, 19 May 2009
Line 7:		Line 7:

	\|-		\|-
	\| '''Study Start Date''' \|\| January, ~~2009~~		\| '''Study Start Date''' \|\| January, 2008
	\|-		\|-
	\| '''Study End Date''' \|\| ~~March~~, ~~2009~~		\| '''Study End Date''' \|\| December, 2008
	\|-		\|-
	\| '''LearnLab Site''' \|\| Central Westmoreland, Riverview, Saltsburg		\| '''LearnLab Site''' \|\| Central Westmoreland, Riverview, Saltsburg
Line 15:		Line 15:
	\| '''LearnLab Course''' \|\| Algebra II		\| '''LearnLab Course''' \|\| Algebra II
	\|-		\|-
	\| '''Number of Students''' \|\|		\| '''Number of Students''' \|\| 126
	\|-		\|-
	\| '''Total Participant Hours''' \|\|		\| '''Total Participant Hours''' \|\| 504
	\|-		\|-
	\| '''DataShop''' \|\| Log data soon to be uploaded and available in the DataShop		\| '''DataShop''' \|\| Log data soon to be uploaded and available in the DataShop

Corbett at 20:38, 19 May 2009

2009-05-19T20:38:49Z

← Older revision		Revision as of 20:38, 19 May 2009
Line 2:		Line 2:
	====Study 1====		====Study 1====
	{\| border="1" cellspacing="0" cellpadding="5" style="text-align: left;"		{\| border="1" cellspacing="0" cellpadding="5" style="text-align: left;"
	\| '''PIs''' \|\| ~~Vincent Aleven~~, ~~Ryan Baker~~, ~~Kirsten Butcher, & Ron Salden~~		\| '''PIs''' \|\| Stephen Reed, Albert Corbett, Bob Hoffman
	\|-		\|-
	\| '''Other Contributers''' \|\| <b>Research Programmers/Associates:</b> Ben MacLaren (Research Programmer, CMU HCII), Angela Wagner (Research Associate, CMU HCII)		\| '''Other Contributers''' \|\| <b>Research Programmers/Associates:</b> Ben MacLaren (Research Programmer, CMU HCII), Angela Wagner (Research Associate, CMU HCII)

Corbett at 20:34, 19 May 2009

2009-05-19T20:34:33Z

← Older revision		Revision as of 20:34, 19 May 2009
Line 11:		Line 11:
	\| '''Study End Date''' \|\| March, 2009		\| '''Study End Date''' \|\| March, 2009
	\|-		\|-
	\| '''LearnLab Site''' \|\| ~~Greenville~~, Riverview, ~~Steel Valley~~		\| '''LearnLab Site''' \|\| Central Westmoreland, Riverview, Saltsburg
	\|-		\|-
	\| '''LearnLab Course''' \|\| ~~Geometry~~		\| '''LearnLab Course''' \|\| Algebra II
	\|-		\|-
	\| '''Number of Students''' \|\|		\| '''Number of Students''' \|\|

Corbett at 20:33, 19 May 2009

2009-05-19T20:33:06Z

← Older revision		Revision as of 20:33, 19 May 2009
Line 4:		Line 4:
	\| '''PIs''' \|\| Vincent Aleven, Ryan Baker, Kirsten Butcher, & Ron Salden		\| '''PIs''' \|\| Vincent Aleven, Ryan Baker, Kirsten Butcher, & Ron Salden
	\|-		\|-
	\| '''Other Contributers''' \|\| <b>Research Programmers/Associates:</b> ~~Octav Popescu~~ (Research Programmer, CMU HCII), ~~Jessica Kalka~~ (Research Associate, CMU HCII)		\| '''Other Contributers''' \|\| <b>Research Programmers/Associates:</b> Ben MacLaren (Research Programmer, CMU HCII), Angela Wagner (Research Associate, CMU HCII)

	\|-		\|-

Corbett at 17:39, 14 May 2009

2009-05-14T17:39:02Z

← Older revision		Revision as of 17:39, 14 May 2009
Line 35:		Line 35:
	Knowing which instructional interventions and principles are synergistic (as well as when interventions and principles do not have any additive effects) is an important practical and theoretical goal within the learning sciences. This project will contribute new knowledge to our understanding of the relationship between instructional principles for robust learning. From a practical perspective, instructional designers often use principles in combination (e.g. Anderson et al, 1995; Quintana et al, 2004); knowing which combinations are effective in concert is therefore pragmatically useful. Further, the project, if successful, will demonstrate that the studied combination of principles leads to dramatically greater effectiveness of one particular intelligent tutoring system. Since these principles are drawn from PSLC theory and research evidence, the successful combination of principles has important implications for the development of PSLC theory, and inference about its eventual impact on learning outcomes. From a theoretical perspective, individual instructional design principles are a convenient way of stating theory; findings related to synergy (or lack thereof) of individual principles impose constraints on the theoretical rationale of each. Thus, this project contributes to both the applied and the theoretical missions of the PSLC.		Knowing which instructional interventions and principles are synergistic (as well as when interventions and principles do not have any additive effects) is an important practical and theoretical goal within the learning sciences. This project will contribute new knowledge to our understanding of the relationship between instructional principles for robust learning. From a practical perspective, instructional designers often use principles in combination (e.g. Anderson et al, 1995; Quintana et al, 2004); knowing which combinations are effective in concert is therefore pragmatically useful. Further, the project, if successful, will demonstrate that the studied combination of principles leads to dramatically greater effectiveness of one particular intelligent tutoring system. Since these principles are drawn from PSLC theory and research evidence, the successful combination of principles has important implications for the development of PSLC theory, and inference about its eventual impact on learning outcomes. From a theoretical perspective, individual instructional design principles are a convenient way of stating theory; findings related to synergy (or lack thereof) of individual principles impose constraints on the theoretical rationale of each. Thus, this project contributes to both the applied and the theoretical missions of the PSLC.

	A summary of the project is in this ~~powerpoint~~ ...		A summary of the project is in this pdf ...[[Media:ReedHoffmanCorbettWorkExSummary.pdf]]

	=== Background & Significance ===		=== Background & Significance ===

Corbett: New page: === Summary Table === ====Study 1==== {| border="1" cellspacing="0" cellpadding="5" style="text-align: left;" | '''PIs''' || Vincent Aleven, Ryan Baker, Kirsten Butcher, & Ron Salden |- | ...

2009-05-14T17:29:10Z

New page: === Summary Table === ====Study 1==== {| border="1" cellspacing="0" cellpadding="5" style="text-align: left;" | '''PIs''' || Vincent Aleven, Ryan Baker, Kirsten Butcher, & Ron Salden |- | ...

New page

=== Summary Table ===
====Study 1====
{| border="1" cellspacing="0" cellpadding="5" style="text-align: left;"
| '''PIs''' || Vincent Aleven, Ryan Baker, Kirsten Butcher, & Ron Salden
|-
| '''Other Contributers''' || <b>Research Programmers/Associates:</b> Octav Popescu (Research Programmer, CMU HCII), Jessica Kalka (Research Associate, CMU HCII)

|-
| '''Study Start Date''' || January, 2009
|-
| '''Study End Date''' || March, 2009
|-
| '''LearnLab Site''' || Greenville, Riverview, Steel Valley
|-
| '''LearnLab Course''' || Geometry
|-
| '''Number of Students''' ||
|-
| '''Total Participant Hours''' ||
|-
| '''DataShop''' || Log data soon to be uploaded and available in the DataShop
|}
=== Abstract ===
The main idea in the current project is to combine instructional interventions derived from five instructional principles. Each of these interventions has been shown to be effective in separate (PSLC) studies, and can be expected on theoretical grounds to be synergistic (or complementary). We hypothesize that instruction that simultaneously implements several principles will be dramatically more effective than instruction that does not implement any of the targeted principles (e.g. current common practice). This project will test this hypothesis, focusing on the following five principles:

• Visual-verbal integration principle
• Worked example principle
• Prompted self-explanation principle
• Accurate knowledge decomposition principle
(part of the complete and efficient practice principle)
• Accurate knowledge estimates principle
(part of the complete and efficient practice principle)

Building on our prior work that tested these principles individually, we will create a new version of the Geometry Cognitive Tutor that implements these five principles. We will use this new version to conduct both a lab experiment and an in vivo experiment to test the hypothesis that the combination of these principles produces a large effect size compared to the standard Cognitive Tutor.
Knowing which instructional interventions and principles are synergistic (as well as when interventions and principles do not have any additive effects) is an important practical and theoretical goal within the learning sciences. This project will contribute new knowledge to our understanding of the relationship between instructional principles for robust learning. From a practical perspective, instructional designers often use principles in combination (e.g. Anderson et al, 1995; Quintana et al, 2004); knowing which combinations are effective in concert is therefore pragmatically useful. Further, the project, if successful, will demonstrate that the studied combination of principles leads to dramatically greater effectiveness of one particular intelligent tutoring system. Since these principles are drawn from PSLC theory and research evidence, the successful combination of principles has important implications for the development of PSLC theory, and inference about its eventual impact on learning outcomes. From a theoretical perspective, individual instructional design principles are a convenient way of stating theory; findings related to synergy (or lack thereof) of individual principles impose constraints on the theoretical rationale of each. Thus, this project contributes to both the applied and the theoretical missions of the PSLC.

A summary of the project is in this powerpoint ...

=== Background & Significance ===

=== Glossary ===
=== Research questions ===

===Planned experiments===
* Lab study (2 phases):
**(1) A two-condition study (comparing the baseline tutor to the modified tutor with all five improvements) testing overall student learning (including measures of robust learning) and efficiency in one tutor unit (Angles).
**(2) Think-aloud (lab) research to determine if worked-examples and visual interaction have the hypothesized, complementary process effects.
* In vivo study: A two-condition in-vivo study (comparing the baseline tutor to the modified tutor with all four improvements). Measures of learning gains and learning efficiency (time taken to complete tutor) will be utilized.

=== Hypotheses ===
=== Explanation ===
=== Further Information ===
==== Connections ====
==== Annotated Bibliography ====
==== References ====
==== Future Plans ====