Difference between revisions of "Visual Feature Focus in Geometry: Instructional Support for Visual Coordination During Learning (Butcher & Aleven)"

From LearnLab
Jump to: navigation, search
(Abstract)
(Future Plans)
 
(26 intermediate revisions by the same user not shown)
Line 18: Line 18:
 
| '''LearnLab Course''' || Geometry
 
| '''LearnLab Course''' || Geometry
 
|-
 
|-
| '''Number of Students''' || Approximately 60
+
| '''Number of Students''' || 50
 
|-
 
|-
| '''Total Participant Hours''' || Approximately 240
+
| '''Total Participant Hours''' || 200
 
|-
 
|-
| '''DataShop''' || N/A (Study is still being run)
+
| '''DataShop''' || Yes.
 
|}
 
|}
 
<br>
 
<br>
Line 41: Line 41:
 
| '''LearnLab Course''' || Geometry
 
| '''LearnLab Course''' || Geometry
 
|-
 
|-
| '''Number of Students''' || Approximately 90
+
| '''Number of Students''' || 83
 
|-
 
|-
| '''Total Participant Hours''' || Approximately 360
+
| '''Total Participant Hours''' || 415
 
|-
 
|-
| '''DataShop''' || N/A (Study has not yet begun)
+
| '''DataShop''' || Yes.
 
|}
 
|}
 
<br>
 
<br>
Line 65: Line 65:
 
=== Research questions ===
 
=== Research questions ===
 
''Study 1: Does coordinated visual-verbal training on geometry concepts prior to problem solving support learning?''
 
''Study 1: Does coordinated visual-verbal training on geometry concepts prior to problem solving support learning?''
 +
This in vivo student extends our understanding of coordinative learning by addressing whether concept learning can be supported by visual-verbal coordination before problem solving practice. This study was conducted at Riverview High School, in Winter 2007-2008 (testing ended in January 2008). In a two condition study, we varied the type of conceptual training that students receive before beginning problem solving activities.
  
This in vivo student extends our understanding of coordinative learning by addressing whether concept learning can be supported by visual-verbal coordination before problem solving practice.
+
<b>Study 1: Independent Variables</b><br>
 +
[[Image:VisualOnlyTraining.jpg]]
 +
<br>
 +
[[Image:VisualVerbalTraining.jpg]]
 +
<br>
  
This study is being conducted at Riverview High School, in Winter 2007-2008 (ending in January 2008). In a two condition study, we vary the type of conceptual training that students receive before beginning problem solving activities. Students receive either (a) Visual-Only training, where visual examples and non-examples are provided to students to support self-generation of relevant verbal definitions, or (b) Visual-Verbal training, where students must select relevant text statements that appropriately define the visual examples and non-examples.  
+
''Study 2: How does coordination of visual and verbal information sources support visual feature understanding and application?''
 +
This in vivo study extends our understanding of coordinative learning by addressing whether visual-verbal coordination maximizes robust learning when coordination is tied to student errors during problem solving. This study was conducted at CWCTC, beginning in late January 2008. The study curriculum was the Angles units of the Geometry Cognitive Tutor. In a 3 condition study, we varied the coordinative learning activities following student errors in the tutor.
  
 +
<b>Study 2: Independent Variables</b><br>
 +
<i><b>No Highlighting</b></i>: Following an error, no highlighting in the visual diagram is provided to students.<br>
 +
[[Image:NoHighlight.jpg]]<br><br>
 +
<i><b>Tutor Highlighting</b></i>: Following an error, the tutor highlighted the features of the problem diagram that are relevant to the selected geometry principle.
 +
[[Image:TutorHighlight.jpg]]<br><br>
 +
<i><b>Student Highlighting</b></i>: Following an error, the student is required to highlight the relevant visual information associated with geometry principles (namely, the features in the diagram to which the selected rule applies).
 +
[[Image:StudentHighlight.jpg]]
  
''Study 2: How does coordination of visual and verbal information sources support visual feature understanding and application?''
+
=== Results ===
 +
''Study 1''
 +
 
 +
Although we hypothesized that coordinative support in linking verbal definitions of geometry concepts to visual examples would support the development of robust knowledge, visual only training was found to be as effective as coordinated visual-verbal training in this study. During early use of the tutor (as seen in the Concept Quiz 1 and Unit 1 Problem Solving results), the pattern of results showed an advantage for students trained in the visual-only condition. However, by posttest (see Overall True/False in the graph), students performed similarly on knowledge assessments.<br>
 +
[[Image:VisVerbTrainingResults.jpg]]
  
This in vivo study extends our understanding of coordinative learning by addressing whether visual-verbal coordination maximizes robust learning when coordination is tied to student errors during problem solving.
 
  
This study is being conducted at CWCTC, beginning in late January 2008; the study curriculum will be Angles units of the Geometry Cognitive Tutor. In a 3 condition study, we vary the coordinative learning activities following student errors in the tutor: (a) following an error, the student highlights relevant visual information associated with geometry principles (namely, the features in the diagram to which the rule applies), (b) the tutor highlights the relevant visual information following a student error, or (c) no highlighting is provided.
 
  
=== Hypotheses ===
+
''Study 2''
''Study 1''
 
  
We hypothesize that coordinative support in linking verbal definitions of geometry concepts to visual examples will support the development of robust knowledge that supports improved problem solving and transfer.  
+
We hypothesized that active [[coordination]] -- where students highlight relevant diagram elements following problem-solving errors -- would best support [[robust learning]]. Although tutor highlighting was hypothesized to be better than the no highlighting (control) condition, we expected that visual-verbal coordination would be best supported by student interaction with diagrams.
  
''Study 2''
+
Overall, student progress was slower than anticipated by the experimenters or the classroom teacher. Of the 83 students working in the intelligent tutor, 31 students (11 Control, 10 Visual Highlighting, 10 Visual Cueing) reached the last instructional unit (unit 3) during the experiment. For these students, results show that benefits of visual self-explanation for problem solving change over the course of tutoring practice (see the figure below).
 +
In the first instructional unit, students provided with visual cueing by the tutor are most accurate in their problem solving answers (M = .89, SD = .05) compared to students in the control condition (M = .83, SD = .06) or the visual-explanation condition (M = .85, SD = .05). Results demonstrated an overall effect of condition (F (2, 27) = 4.01, p = .03); post-hoc Bonferroni comparisons demonstrated that visual cueing significantly outperformed the control condition (p = .03) but not the visual self-explanation condition (p = .15), which fell between the two other groups. In contrast, by unit 3, students who visually self-explained the geometry principles (M = .86, SD = .08) were most accurate in their problem-solving answers, followed by the visual cueing condition (M = .83, SD = .11), and then the control condition (M = .73, p = .10). Results again demonstrated an overall effect of condition (F(2, 27) = 4.84, p = .016); post-hoc Bonferroni comparisons showed that the control condition was outperfomed by the visual self-explanations (p =  .03) and the visual cueing (p = .05) conditions. <br><br>
 +
We analyzed overall posttest and delayed posttest results for students who had also taken the pretest. Posttest results demonstrated an overall improvement from pre- to posttest (F(1, 65) = 9.68, p = .03), but no significant condition differences (F<1).  At delayed posttest, result suggested a test time (pretest vs. delayed posttest) by condition interaction (F(2. 37) = 2.87, p = .07).  At delayed posttest (see Figure 2), students in the visual self-explanation condition outperformed students from the visual cueing condition and the control (interactive diagram) condition. <br>
  
We hypothesize that active coordination -- where students highlight relevant diagram elements following problem-solving errors -- will best support robust learning. Although tutor highlighting should support learning better than the no highlighting (control) condition, we expect that visual-verbal coordination will be best supported by student interaction.
+
[[Image:EarliGraph.jpg]]
  
 
=== Explanation ===
 
=== Explanation ===
Line 97: Line 113:
  
 
*Butcher, K. R., & Aleven, V. (2007). Integrating visual and verbal knowledge during classroom learning with computer tutors. In D. S. McNamara & J. G. Trafton (Eds.), Proceedings of the 29th Annual Cognitive Science Society (pp. 137-142). Austin, TX: Cognitive Science Society.
 
*Butcher, K. R., & Aleven, V. (2007). Integrating visual and verbal knowledge during classroom learning with computer tutors. In D. S. McNamara & J. G. Trafton (Eds.), Proceedings of the 29th Annual Cognitive Science Society (pp. 137-142). Austin, TX: Cognitive Science Society.
 +
*Butcher, K. R., & Aleven, V. A. (in press 2009).  Visual self-explanation during intelligent tutoring? More than attentional focus? <i>European Association for Research on Learning and Instruction</i>, 13th Biennial Conference. August 25-29, 2009: Amsterdam, the Netherlands.
  
 
==== References ====
 
==== References ====
Line 104: Line 121:
  
 
====Future Plans====
 
====Future Plans====
*January 2008: Finish study at Riverview, begin study at CWCTC
+
*August 2009: Symposium presentation at EARLI 2009
*February 2008: Work with Datashop to upload Riverview data; monitor study progress at CWCTC
+
*July - September 2009: Prepare article and submit to journal
*March 2008: Analyze data from Riverview; finish study at CWCTC
 
*April 2008: Administer long-term retention test at CWCTC; work with Datashop to upload CWCTC data
 
  
 
[[Category:Study]]
 
[[Category:Study]]

Latest revision as of 00:39, 9 May 2009

Visual Feature Focus in Geometry: Instructional Support for Visual Coordination During Learning

Kirsten Butcher & Vincent Aleven

Summary Table

Study 1

PIs Kirsten R. Butcher & Vincent Aleven
Other Contributers Research Programmers/Associates: Octav Popescu (Research Programmer, CMU HCII), Thomas Bolster (Research Associate, CMU HCII), Michael Nugent, Research Programmer CMU HCII)
Study Start Date December 2007
Study End Date February 2008
LearnLab Site Riverview High School
LearnLab Course Geometry
Number of Students 50
Total Participant Hours 200
DataShop Yes.


Study 2

PIs Kirsten R. Butcher & Vincent Aleven
Other Contributers Research Programmers/Associates: Octav Popescu (Research Programmer, CMU HCII), Thomas Bolster (Research Associate, CMU HCII), Michael Nugent, Research Programmer CMU HCII)
Study Start Date January 28, 2008
Study End Date March 2008
LearnLab Site Central Westmoreland Career & Technology Center (CWCTC)
LearnLab Course Geometry
Number of Students 83
Total Participant Hours 415
DataShop Yes.


Abstract

Is visual-verbal integration a major source of difficulty for students learning geometry? Further, how can coordinative learning with visual and verbal knowledge components in geometry be supported by instructional events that vary the support for and type of sense making in which learners engage during problem solving? In geometry, students may have difficulty integrating visual and verbal information sources for two reasons: first, they may lack deep understanding of geometry concepts (e.g., what is an interior angle?) that are relevant to problem-solving principles (e.g., the interior angles theorem for circles); second, students may be unable to coordinate visual problem features with verbal principles during problem solving. Our research explores the robust learning effects associated with visual-verbal training of geometry features and varied levels of instructional assistance in coordinating visual diagram features with verbal geometry principles during problem solving.

Background & Significance

Successful Learning is Supported by Coordinated Visual-Verbal Knowledge

Research with both experts and more novice learners has shown that integrated visual-verbal knowledge supports successful problem solving. In geometry, for example, experts use key diagram configurations to cue retrieval of relevant schemas, and these visual configurations help successfully model expert proof (Koedinger & Anderson, 1990). In mathematics, experts are more likely than novices to generate diagrams and to use these visual representations to guide their reasoning about problem-solving steps (Stylianou, 2002).

Even for more novice learners, learning benefits are seen when visual and verbal information is processed jointly instead of in isolation. In geometry, superficial visual similarities between geometry diagrams can decrease a novice’s likelihood of problem-solving success because novices focus on irrelevant visual similarities at the expense of conceptual problem differences (Lovett & Anderson, 1994). Even when visualizations depict helpful (rather than misleading) information for learning, verbal explanations support deeper understanding. For example, the value of graphical feedback when using a physics simulation is greatly enhanced by the presence of short, embedded verbal explanations that focus learners on key principles (Rieber, Tzeng, & Tribble, 2004). Similarly, learners suffer when verbal information is processed alone. Visual representations that are designed to be informationally-equivalent to a given piece of text or audio nevertheless support deeper understanding of the text (Ainsworth & Loizou, 2003; Butcher, 2006) or audio explanations (e.g., Moreno & Mayer, 2002). Further, students benefit from activities that coordinate both visual and verbal sources; these activities include verbal comparison of self-generated and ideal diagrams (Van Meter, 2001; Van Meter, Aleksic, Schwartz, & Garner, 2006) as well as dragging and dropping verbal information into a diagram to create an integrated representation (Bodemer, Ploetzner, Feuerlein, & Spada, 2004).

The potential importance of connecting visual and verbal information also is supported by the literature on knowledge transfer following example learning, where the use of abstract rules can combat problems associated with focus on superficial similarity. Although examples often support problem solving, students frequently are unable to successfully solve transfer problems that are not superficially very similar to the trained examples (for a review, see Reeves & Weissberg, 1994). Research in reasoning and transfer has found that student performance is better supported by examples that include instruction on abstract rules when compared to learning with examples alone or instruction alone (Fong, Krantz, & Nisbett, 1986; Fong & Nisbett, 1991). Thus, we should expect that when students connect geometry diagrams (examples) to relevant geometry principles (abstract rules), robust learning will be supported.

Glossary

Research questions

Study 1: Does coordinated visual-verbal training on geometry concepts prior to problem solving support learning? This in vivo student extends our understanding of coordinative learning by addressing whether concept learning can be supported by visual-verbal coordination before problem solving practice. This study was conducted at Riverview High School, in Winter 2007-2008 (testing ended in January 2008). In a two condition study, we varied the type of conceptual training that students receive before beginning problem solving activities.

Study 1: Independent Variables
VisualOnlyTraining.jpg
VisualVerbalTraining.jpg

Study 2: How does coordination of visual and verbal information sources support visual feature understanding and application? This in vivo study extends our understanding of coordinative learning by addressing whether visual-verbal coordination maximizes robust learning when coordination is tied to student errors during problem solving. This study was conducted at CWCTC, beginning in late January 2008. The study curriculum was the Angles units of the Geometry Cognitive Tutor. In a 3 condition study, we varied the coordinative learning activities following student errors in the tutor.

Study 2: Independent Variables
No Highlighting: Following an error, no highlighting in the visual diagram is provided to students.
NoHighlight.jpg

Tutor Highlighting: Following an error, the tutor highlighted the features of the problem diagram that are relevant to the selected geometry principle. TutorHighlight.jpg

Student Highlighting: Following an error, the student is required to highlight the relevant visual information associated with geometry principles (namely, the features in the diagram to which the selected rule applies). StudentHighlight.jpg

Results

Study 1

Although we hypothesized that coordinative support in linking verbal definitions of geometry concepts to visual examples would support the development of robust knowledge, visual only training was found to be as effective as coordinated visual-verbal training in this study. During early use of the tutor (as seen in the Concept Quiz 1 and Unit 1 Problem Solving results), the pattern of results showed an advantage for students trained in the visual-only condition. However, by posttest (see Overall True/False in the graph), students performed similarly on knowledge assessments.
VisVerbTrainingResults.jpg


Study 2

We hypothesized that active coordination -- where students highlight relevant diagram elements following problem-solving errors -- would best support robust learning. Although tutor highlighting was hypothesized to be better than the no highlighting (control) condition, we expected that visual-verbal coordination would be best supported by student interaction with diagrams.

Overall, student progress was slower than anticipated by the experimenters or the classroom teacher. Of the 83 students working in the intelligent tutor, 31 students (11 Control, 10 Visual Highlighting, 10 Visual Cueing) reached the last instructional unit (unit 3) during the experiment. For these students, results show that benefits of visual self-explanation for problem solving change over the course of tutoring practice (see the figure below). In the first instructional unit, students provided with visual cueing by the tutor are most accurate in their problem solving answers (M = .89, SD = .05) compared to students in the control condition (M = .83, SD = .06) or the visual-explanation condition (M = .85, SD = .05). Results demonstrated an overall effect of condition (F (2, 27) = 4.01, p = .03); post-hoc Bonferroni comparisons demonstrated that visual cueing significantly outperformed the control condition (p = .03) but not the visual self-explanation condition (p = .15), which fell between the two other groups. In contrast, by unit 3, students who visually self-explained the geometry principles (M = .86, SD = .08) were most accurate in their problem-solving answers, followed by the visual cueing condition (M = .83, SD = .11), and then the control condition (M = .73, p = .10). Results again demonstrated an overall effect of condition (F(2, 27) = 4.84, p = .016); post-hoc Bonferroni comparisons showed that the control condition was outperfomed by the visual self-explanations (p = .03) and the visual cueing (p = .05) conditions.

We analyzed overall posttest and delayed posttest results for students who had also taken the pretest. Posttest results demonstrated an overall improvement from pre- to posttest (F(1, 65) = 9.68, p = .03), but no significant condition differences (F<1). At delayed posttest, result suggested a test time (pretest vs. delayed posttest) by condition interaction (F(2. 37) = 2.87, p = .07). At delayed posttest (see Figure 2), students in the visual self-explanation condition outperformed students from the visual cueing condition and the control (interactive diagram) condition.

EarliGraph.jpg

Explanation

From a Coordinative Learning Cluster perspective, coordination between visual and verbal information supports foundational skill building, because attending to both representations simultaneously associates features from both with the learned knowledge components. This association increases feature validity and promotes robust learning.

Further Information

Connections

Annotated Bibliography

  • Butcher, K. R., & Aleven, V. (2007). Integrating visual and verbal knowledge during classroom learning with computer tutors. In D. S. McNamara & J. G. Trafton (Eds.), Proceedings of the 29th Annual Cognitive Science Society (pp. 137-142). Austin, TX: Cognitive Science Society.
  • Butcher, K. R., & Aleven, V. A. (in press 2009). Visual self-explanation during intelligent tutoring? More than attentional focus? European Association for Research on Learning and Instruction, 13th Biennial Conference. August 25-29, 2009: Amsterdam, the Netherlands.

References

Future Plans

  • August 2009: Symposium presentation at EARLI 2009
  • July - September 2009: Prepare article and submit to journal