Booth
Contents
- 1 Knowledge component construction vs. recall
Knowledge component construction vs. recall
Julie Booth, Robert Siegler, Ken Koedinger & Bethany Rittle-Johnson
- PI: Julie Booth
- Other key faculty: Ken Koedinger, Robert Siegler, Bethany Rittle-Johnson
- Studies: 2 complete, 1 in progress
Abstract
This project examines the effectiveness of corrective self-explanation, or explanation of incorrect worked examples, for improving students' knowledge components for solving algebraic equations. Students in classrooms which are using the Algebra Cognitive Tutor curriculum will complete such exercises during their otherwise typical experience solving equations with the Tutor to determine whether coordination of the two instructional methods increases robust learning; as a control, other students in the classroom will receive typical self-explanation exercises (explanation of correct worked examples) or no self-explanation exercises amid their tutor problems (Ecological control group). Robust learning will be assessed using measures of long-term retention, transfer, and accelerated future learning.
Glossary
- Corrective Self-Explanations: Self-explanations of incorrect worked examples; explaining how and why they are incorrect
- Incorrect worked examples: Examples that include errors
Research Question
Students tend to learn overgeneralized knowledge components and apply them when attempting to solve algebra problems with incorrect features. How can we help them to learn correct knowledge components? And when is combining exercises designed to improve conceptual knowledge with tutored procedural exercises effective for improving robust learning of algebraic problem-solving?
Background and Significance
Errors are inevitable when individuals are first learning any skill; solving algebraic equations is no exception. Students often use incorrect knowledge components when learning Algebra (Lerch, 2004; Sebrechts, Enright, Bennett, & Martin, 1996), and use of incorrect knowledge components has been attributed to misunderstandings or gaps in students’ conceptual knowledge of Algebra (Anderson, 1989; Van Lehn & Jones, 1993). Results from Experiment 1 in Booth et al.’s current PSLC project confirm this hypothesis; a lack of knowledge about certain features in the problems (e.g., negatives, equals sign, like terms) was associated with use of related incorrect knowledge components on the problem-solving task. For example, students who do not see negatives as integral parts of terms in algebraic equations, or who believe that negatives can enter and exit equations without consequence tend to apply knowledge components with incorrect (or incomplete) features when solving equations, such as behaving in accordance with “to remove a term from an equation, subtract it from both sides” rather than with a knowledge component with feature validity that specifies “positive term” in the predicate, Thus, improving students’ knowledge of the conceptual features that underlie Algebra may be necessary for robust learning to occur.
Siegler’s overlapping waves theory suggests that there are two important steps that are necessary to improve knowledge (Siegler, 1996): 1) Weaken the incorrect knowledge component, and 2)Construct and strengthen correct knowledge component. One way to accomplish this is through self-explanation, or generating explanations about instructional material. Chi and her colleagues (e.g., Chi, 2000; Roy & Chi, 2005) have shown that self-explanation is useful for a variety of purposes, including generating new knowledge to fill gaps and repairing faulty knowledge. Siegler (2002) suggests that one particular type of self-explanation may be especially useful for repairing faulty knowledge: explaining why the procedures used in incorrect worked examples are wrong. This self-explanation of incorrect worked examples (why they’re wrong) can weaken students’ overgeneralized knowledge components by helping them to understand both that the knowledge components are incorrect and what relevant features make them incorrect.
Dependent Variables
Normal posttest. Near transfer—immediate in which isomorphic problems to instruction are included for students to solve. (e.g., 3x + 10 = 20, 4x/3 + 4 = 16, 2/(-5x) = 14)
Long-term retention. Embedded assessment within instruction by the Cognitive Tutor. We will collect log data from the review portion of the next equation-solving Tutor unit to determine whether correct knowledge components are applied.
Transfer. Problems included on the posttest in two forms: 1)Procedural format with more difficult problems/problems with additional features (e.g., 2x - 7 = -5x + 9, 4/(6x) – 7 = 32). 2) Conceptual format assessing knowledge of features (e.g., State whether each of the following is the same as 3 – 4x: a. 3 + 4x b. 3 + (-4x) c. 4x – 3 d. 4x + 3)
Accelerated future learning. We will collect log data during tutor instruction in the next equation-solving Tutor unit when treatment is no longer in place to determine whether the slope of the learning curve is greater for students who received the corrective self-explanation treatment.
Independent Variables
Two types of self-explanation exercises:
1) Typical self-explanation (explanation of correct worked examples)
2) Corrective self-explanation (explanation of incorrect worked examples)
The design is a 2 x 2 factorial with two levels of typical self-explanation (yes or no) and two levels of corrective self-explanation (yes and no). The result is that within any participating classroom, one fourth of students received typical self-explanation, one fourth received corrective self-explanation, one fourth received both, and one fourth received neither (the current tutor as-is, the ecological control group.
Hypothesis
Self-explanation of incorrect worked examples (why they’re wrong) combined with procedural practice can lead to robust learning through two processes: 1) Weaken low-feature validity knowledge components (know that they’re wrong and why they’re wrong) 2) Facilitate construction of high-feature validity knowledge components.
Findings
Findings for Experiments 1a and 1b:
- Pretest misconceptions about features are related to use of specific incorrect knowledge components to solve problems Concepts related to specific buggy procedures
- Having knowledge of the features of negativity and equality predicts correctness on procedural problems (p’s < .05 and .01)
- Students do improve from pretest to posttest, but roughly 1/3 of students still lack each of the features at posttest
- Pretest conceptual knowledge predicts students' pretest to posttest gain in procedural knowledge after using the Algebra Tutor as is
- Specifically, having conceptual knowledge of the equals sign feature leads to more learning than if that knowledge was not present at pretest.
Expected findings for Experiment 2:
- Students who receive corrective self-explanation exercises will show greater robust learning of both implicit and explicit knowledge components for solving algebraic equations compared with students in other conditions.
- Those who receive typical self explanation exercises will show greater robust learning than those who do not get any type of self-explanation exercises (ecological control group), but are not expected to show reduced use of incorrect knowledge components as are the groups that complete corrective self-explanation exercises.
- Corrective self-explanation will affect students differently based on the amount and quality of their knowledge components prior to beginning the treatment. Students with high-feature validity knowledge components may not require corrective self-explanation for success; students with few relevant knowledge components of any sort (correct or incorrect) may not benefit from corrective self-explanation until they have acquired low-feature validity knowledge components in need of correction.
Explanation
Students who receive corrective self-explanation exercises are expected to gain improved explicit (conceptual) knowledge about the features in problems that make certain knowledge components inappropriate. This expected to lead to greater robust learning compared with the other conditions that gain only implicit knowledge or explicit knowledge but do not have this additional knowledge about when it is appropriate to apply their knowledge components.
Descendents
None
Annotated Bibliography
- Presentation to the PSLC Advisory Board, Fall 2006. Link to Powerpoint slides
Further Information
Plans for June 2007-December 2007
• Write and submit a journal article describing results from Experiments 1a and 1b.
• Analyze data from Experiment 2 to determine whether corrective self-explanation improved robust learning of algebraic problem-solving.
• Begin to analyze individual differences in the effectiveness of combining corrective self-explanation with tutored procedural practice based on pretest conceptual understanding of features.
• Replicate Experiment 2 in a more diverse population
References
Anderson, J.R. (1989). The analogical origins of errors in problem solving. In D. Klahr & K. Kotovsky (Eds). Complex information processing: The impact of Herbert A. Simon. (pp. 343-371). Hillsdale, NJ, England: Lawrence Erlbaum Associates, Inc.
Chi, M.T.H. (2000) Self-explaining expository texts: The dual processes of generating inferences and repairing mental models. In Glaser, R. (Ed.) Advances in Insturctional Psychology, Mahwah, NJ: Lawrence Erlbaum Associates, pp. 161-238.
Lerch, C. M. (2004). Control decisions and personal beliefs: Their effect on solving mathematical problems. Journal of Mathematical Behavior, 23, 21-36.
Roy, M. & Chi, M.T.H. (2005). Self-explanation in a multi-media context. In R. Mayer (Ed.), Cambridge Handbook of Multimedia Learning (pp. 271-286). Cambridge Press.
Siegler, R.S. (1996). Emerging minds: The process of change in children’s thinking. New York: Oxford University Press.
Siegler, R. S. (2002). Microgenetic studies of self-explanations. In N. Granott & J. Parziale (Eds.), Microdevelopment: Transition processes in development and learning (pp. 31-58). New York: Cambridge University.
Van Lehn, K., & Jones, R.M. (1993). What mediates the self-explanation effect? Knowledge gaps, schemas, or analogies? In M. Polson (Ed.) Proceedings of the Fifteenth Annual Conference of the Cognitive Science Society (pp. 1034-1039).
