Difference between revisions of "Instructional Principles and Hypotheses"

From LearnLab
Jump to: navigation, search
m
 
(61 intermediate revisions by 10 users not shown)
Line 1: Line 1:
 +
===Generalization Hierarchy of Principles===
 +
 +
* [[Refinement and Fluency]]
 +
** [[Optimized scheduling]].  Optimized scheduling yields better long-term retention than a practice schedule based on fixed intervals (whether massed or spaced) or intervals self-determined by students (e.g., in flash card use).
 +
** [[Feature focusing]].  Instruction leads to more robust learning when it guides the learner's attention ("focuses") toward relevant features of the material, as opposed to unfocused instruction or instruction that guides attention toward irrelevant features.
 +
 +
* [[Sense making]]
 +
** [[Visual-verbal integration]].  Instruction that includes both visual and verbal information leads to more robust learning than instruction that includes verbal information alone, but only when the instruction supports learners as they coordinate information from both sources and the representations guide student attention to deep features.
 +
** [[Example-rule coordination principle]]. Instruction that combines or helps students' combine learning from examples and learning of or from rules tends to be more effective than instruction that includes the same examples and rules but does not help students combine them.
 +
*** [[Worked example principle]].  In contrast to the traditional approach of giving a list homework (or seatwork) problems for students to solve, students learn more efficiently and more robustly when more frequent study of [[worked examples]] is interleaved with problem solving practice.
 +
*** [[Prompted self-explanation principle]]. When students are given a worked example or text to study, prompting them to self-explain each step of the worked example or each line of the text causes higher learning gains than having them study the material without such prompting.
 +
**** [[Corrective self-explanation]].  Explaining how and why incorrect solutions are incorrect will help students to reject incorrect [[knowledge components]] and, thus, stop using incorrect strategies to solve problems.
 +
*** [[Analogical comparison principle]]. Analogical comparison can facilitate schema abstraction and transfer of that knowledge to new problem. By comparing the commonalities between two examples, students can focus on the causal structure and improve their learning about the concept.
 +
 +
* [[Metacognition and Motivation|Motivation]]
 +
** [[Personalization]]. Matching up the features of an instructional event with students' personal interests, experiences, or typical patterns of language use, may lead to more robust learning compared to when instruction is not personalized.
 +
 +
 +
 +
 +
See also [[:Category:Instructional Principle]].  Other possibilities for principles can be found further below and also at other web sites:
 +
* [http://www.edu-design-principles.org Design Principles Database] maintained by the NSF-funded [http://www.telscenter.org/ TELS (Technology Enhanced Learning in Science)] project
 +
* [http://www.psyc.memphis.edu/learning/principles/ Principles of Learning] from Lifelong Learning at Work and at Home
 +
* [http://ies.ed.gov/ncee/wwc/pdf/practiceguides/20072004.pdf Organizing Instruction and Study to Improve Student Learning], one of the Practice Guides of the Department of Education, Institute for Education Sciences
 +
* [http://www.cmu.edu/teaching/principles/ Principles of Teaching and Learning] from CMU's Eberly Center for Teaching and Learning
 +
 
===Creating Instructional Principle and Hypothesis Pages===
 
===Creating Instructional Principle and Hypothesis Pages===
The PSLC is starting to maintain a collection of instructional principle pages. Each instructional principle page should be structured with the following headers:
+
Each instructional principle page is structured with the following headers:
  
#Brief statement of principle
+
#Brief statement of the principle
#Description of principle
+
#Description of the principle
 
##Operational definition
 
##Operational definition
 
##Examples
 
##Examples
 
#Experimental support
 
#Experimental support
##Level of support (either low, medium, or high) (See the recent IES practice guide on [http://ies.ed.gov/ncee/wwc/practiceguides/ "Organizing Instruction and Study to Improve Student Learning"] for definitions of levels of support.)
 
 
##Laboratory experiment support
 
##Laboratory experiment support
 
##In vivo experiment support
 
##In vivo experiment support
 +
##Level of support (either low, medium, or high) (See the IES practice guide on [http://ies.ed.gov/ncee/wwc/pdf/practiceguides/20072004.pdf "Organizing Instruction and Study to Improve Student Learning"] for definitions of levels of support.)
 
#Theoretical rationale (these entries should link to one or more [[:Category:Learning Processes|learning processes]])
 
#Theoretical rationale (these entries should link to one or more [[:Category:Learning Processes|learning processes]])
 
#Conditions of application
 
#Conditions of application
 +
##Failed replications (which suggest conditions of application are needed)
 
#Caveats, limitations, open issues, or dissenting views
 
#Caveats, limitations, open issues, or dissenting views
 
#Variations (descendants)
 
#Variations (descendants)
Line 17: Line 44:
 
#References
 
#References
  
If you have a study page, your hypothesis section should make reference to at least one of these instructional principle pages.  You should edit your hypothesis section to be sure it points to an instructional principle page.  Then you should edit that instructional principle page so that it 1) at least has the structure above (even if all sections aren't filled in) and 2) fill in or edit sections so they are consistent with your views.  A template you can copy is provided further below.   
+
If you have a study page, your hypothesis section should make reference to at least one of these instructional principle pages.  You should edit your hypothesis section to be sure it points to an instructional principle page.  Then you should edit that instructional principle page so that it at least (1) has the structure above (even if all sections aren't filled in -- a template you can copy is provided further below) and (2) points to your study with a brief summary of the results.  You should also (3) read the entry carefully and fill in or edit sections so they are consistent with your findings and with relevant theory.   
  
We want to keep the number of principles down, at least at the highest level if generalization, so try to reference the most general instructional principle that is appropriate.  In addition to facilitating our goal of greater shared vocabulary and unification, doing so will also make it so you have less editing work to do!  By pointing to more general instructional principles, others will be contributing to structuring and filling in that page in addition to you.  You may also point to (from your hypothesis section) more specific instructional principle pages relevant to your study.
+
We want to keep the number of principles down, at least at the highest level of generalization, so try to reference the most general instructional principle that is appropriate.  In addition to facilitating our goal of greater shared vocabulary and unification, doing so will also make it so you have less editing work to do!  By pointing to more general instructional principles, others will be contributing to structuring and filling in that page in addition to you.  You may also point to (from your hypothesis section) more specific instructional principle pages relevant to your study.
  
 
Be sure that the *Examples* and *Experimental Support* sections of the instructional principle page you point to also points back to your study page.
 
Be sure that the *Examples* and *Experimental Support* sections of the instructional principle page you point to also points back to your study page.
  
Please also add references to the literature outside of PSLC to the *Reference* section of instructional principles pages you edit.  You might simply copy these from your study page's reference section and/or papers your write.  By doing so, you can help others (and others can help you) identify relevant research in the field.
+
Please also add references to literature beyond your own work to the *Reference* section of instructional principles pages you edit.  You might simply copy these from your study page's reference section and/or papers you have written.  By doing so, you can help others (and others can help you) identify relevant research in the field.
 
 
===List of Instructional Principles and Hypotheses===
 
 
 
From [[:Category:Independent Variables]]
 
 
 
==== Cross-cutting all 3 clusters ====
 
 
 
* [[Tutoring feedback]]
 
** [[Peer tutoring]]
 
** [[Prompted Self-explanation]]
 
 
 
==== [[Coordinative Learning]] ====
 
 
 
* [[Example-rule coordination]] - (NOTE: See the recent IES practice guide on [http://ies.ed.gov/ncee/wwc/practiceguides/ "Organizing Instruction and Study to Improve Student Learning"] as a great source for relevant references. See particularly the recommendations on interleaving worked examples and multimedia (written primarily by Ken Koedinger).)
 
** [[Worked example principle]].  See also [[Worked examples]] and [[Learning by worked-out examples]].
 
** [[Self-explanation]] - listed as "prompted self-explanation" in matrices, which is a better name for an instructional method/principle (something an instructor does or an instructional designer creates) whereas "self-explanation" is a better name for a learning process (something a student's mind does)
 
*** [[Corrective self-explanation]]
 
* [[Visual-verbal integration]]
 
** [[Contiguous Representation]]
 
* [[Feature focusing]]
 
 
 
====[[Interactive Communication]]====
 
*[[Collaboration]]
 
**[[Peer tutoring]]
 
*[[Collaboration scripts]]
 
*[[Collaboratively observe]]
 
**[[Vicarious learning]]
 
*[[Deep/Reflection questions]] - term in matrix (to the left) is not the same as glossary entry, [[Deep-level question]]. (NOTE: See the recent IES practice guide on [http://ies.ed.gov/ncee/wwc/practiceguides/ "Organizing Instruction and Study to Improve Student Learning"] as a great source for relevant references. See particularly the "deep questioning" recommendation (written primarily by Art Graesser).)
 
**[[Reflection questions]]
 
***[[Post-practice reflection]]
 
**[[Knowledge Construction Dialogues]]
 
**[[Self-explanation]] - listed as "prompted self-explanation" in matrices (see above)
 
***[[Elaborated Explanations]] - should this be a learning process (something a student does) rather than an instructional method (something instruction does)?  "Prompting for X" can make a learning process into an instructional method (whether the method works or not is a separate question).
 
***[[Jointly constructed explanation]] - also perhaps a learning process? 
 
*[[Instructional explanation]]
 
 
 
====[[Refinement and Fluency]]====
 
*[[Active Processing]] in matrix, but not in glossary.  See [[Practice]], [[Drill]], [[Learning by problem solving]]
 
*[[Error correction support]]
 
*[[Explicit instruction]]
 
*[[Fluency Pressure]] in matrix, but not in glossary. See [[Fluency]]
 
*[[Feedback Timing]] in matrix, but not in glossary.
 
*[[Feature focusing]]
 
*[[Knowledge Accessibility]] in matrix, but not in glossary. See [[Accessibility]]
 
*[[Optimized scheduling]]  in glossary, but not listed as independent variable - (NOTE: See the recent IES practice guide on [http://ies.ed.gov/ncee/wwc/practiceguides/ "Organizing Instruction and Study to Improve Student Learning"] as a great source for relevant references. See particularly the spacing recommendation (written primarily by Hal Pashler). However, recent work by Pavlik qualifies conclusions of Pashler because most of the research referenced does not control for time on task.)
 
** See also [[Learning event scheduling]] and [[Instructional schedule]]
 
  
====Unclassified====
+
====Template====
[[Assistance]]
 
[[Availability]]
 
[[Fading]]
 
[[Implicit instruction]]
 
[[Instructional method]]
 
[[Scaffolding]]
 
 
 
===Template===
 
 
You can copy the following into an instructional principle page you want to edit and then insert existing text into appropriate sections and add text in other sections.
 
You can copy the following into an instructional principle page you want to edit and then insert existing text into appropriate sections and add text in other sections.
  
Line 90: Line 63:
 
===Laboratory experiment support===
 
===Laboratory experiment support===
 
===In vivo experiment support===
 
===In vivo experiment support===
 +
===Level of support===
 
==Theoretical rationale==  
 
==Theoretical rationale==  
 
(These entries should link to one or more [[:Category:Learning Processes|learning processes]].)
 
(These entries should link to one or more [[:Category:Learning Processes|learning processes]].)
Line 97: Line 71:
 
==Generalizations (ascendants)==
 
==Generalizations (ascendants)==
 
==References==
 
==References==
 +
[[Category:Glossary]]
 +
[[Category:Instructional Principle]]
 
</pre>
 
</pre>
  
===A (temporary!) note on editing instructional principles and hypotheses pages===
+
====Editing instructional principle pages====
When you edit one of the existing "instructional principle" or "independent variable" pages listed above, note that many of the current (as of October, 2007) pages describe an instructional method and need to be appropriately modified to describe an instructional principle.  An instructional principle entry should state a hypothesis about how a target instructional method is better than some other baseline or control method.  For example, Mayer's multimedia principle states that using diagrams in text (one instructional method) leads to better learning than text along (another instructional method) under certain circumstances.   
+
 
 +
An [[:Category:Instructional Principle|instructional principle]] is usually so closely related to an independent variable that it is hard to tell them apart.  An instructional principle is a general hypothesis, usually about how one [[instructional method]] is better than some other baseline or control method.  For example, Mayer's [[multimedia principle]] states that using diagrams in text (one instructional method) leads to better learning than text alone (another instructional method) under certain circumstances.  When a study varies the instructional method, then the instruction method is a kind of [[:Category:Independent Variables|independent variable]], so in this wiki, they are usually described on independent variable wiki pages.  However, an instructional principle is often so closely related to one of its independent variables/methods that the two wiki pages share considerable content.  If so, then maybe it would be best to just have one page for both.  Use your best judgment. 
 +
 
 +
If you do choose to use separate pages for an instructional principle and a related independent variable, please put "principle" or "hypothesis" in the title of the instructional principle.  For instance, the [[Worked example principle]] page is different from but related to the [[worked examples]] page.  The [[Prompted self-explanation hypothesis]] page is different from the [[Prompted Self-explanation]] page.
 +
 
 +
Instructional principles are related to the *hypothesis* section of study pages.  The hypothesis of a study may be more study- or domain-specific whereas the associated instructional principle will be study-neutral and likely more domain general.  Therefore, the wiki page documenting a project or study should have:
 +
 
 +
* an independent variables section that refers to the wiki pages of general independent variables.  These are found in the column headers of the matrix that appears on your cluster's page.
 +
 
 +
* a hypothesis section that refers to the wiki pages of general instructional principles.  These instructional principles should reference the general independent variables mentioned above.
 +
 
 +
If some of the structure above does not exist, please create it.
 +
 
 +
=== Candidate Instructional Principles ===
 +
 
 +
The following instructional method or [[:Category:Independent Variables|independent variable]] pages are candidates that you might convert to a structured principle page. See directions on structuring a instructional principle or hypothesis page further below.
 +
 
 +
* APS LifeLong Learning [http://www.psyc.memphis.edu/learning/principles/ Principles of Learning].  Note, though, that as principles of "learning" (not instruction) these may better belong as "learning processes" pages (see below) rather than as principles of instruction.
 +
**[[Prior Knowledge]]
 +
**[[Experience Alone]]
 +
**[[Practice at Retrieval]]
 +
**[[Learning Epistemologies]]
 +
**[[Variable Learning I]]
 +
**[[Variable Learning II]]
 +
**[[Avoid Passive Learning]]
 +
**[[Process of Remembering]]
 +
**[[Less is More]]
 +
 
 +
 
 +
* Cross-cutting all 3 clusters (move above when written as principle/hypoth page)
 +
** [[Tutoring feedback]]
 +
*** [[Peer tutoring]]
 +
 
 +
* [[Coordinative Learning]] (move above when written as principle/hypoth page)
 +
**[[Visual-verbal integration]] - This has been promoted, but a principle page for the descendant, [[Multimedia principle]], has not yet been created.
 +
***[[Multimedia principle]]
 +
 
 +
* [[Interactive Communication]] (move above when written as principle/hypoth page)
 +
**[[Collaboration]]
 +
***[[Peer tutoring]]
 +
***[[Collaboration scripts]]
 +
***[[Collaboratively observe]]
 +
**[[Vicarious learning]]
 +
**[[Deep/Reflection questions]]. (NOTE: See  the "deep questioning" recommendation in [http://ies.ed.gov/ncee/wwc/practiceguides/)
 +
**[[Reflection questions]]
 +
***[[Post-practice reflection]]
 +
**[[deep-level question]]s
 +
**[[Knowledge Construction Dialogues]]
 +
**[[Prompted Self-explanation]]
 +
***[[Elaborated Explanations]] - should this be a learning process (something a student does) rather than an instructional method (something instruction does)?  "Prompting for X" can make a learning process into an instructional method (whether the method works or not is a separate question).
 +
***[[Jointly constructed explanation]] - also perhaps a learning process? 
 +
**[[Instructional explanation]]
  
Instructional principles are like (or may fill) the *hypothesis* section of study pages, though the hypothesis of a study may be more study or domain specific whereas the associated instructional principle will be study-neutral and likely more domain general. The current (as of October, 2007) instructional method pages are like (or may fill) the *independent variables* section of the study pages.  
+
*[[Refinement and Fluency]] (move above when written as principle/hypoth page)
 +
**[[Feature focusing]] - This has been promoted, but the descendant, explicit instruction, is not expressed as a hypothesis or principle
 +
***[[Explicit instruction]] - Not clear this leads to a separate principle
 +
**[[Fluency Pressure]]
 +
**[[Feedback Timing]] in matrix, but not in glossary.  
 +
**[[Error correction support]]
 +
**[[Knowledge Accessibility]] in matrix, but not in glossary. See [[Accessibility]]
  
Perhaps we need both types of pages (instructional principles and instructional methods), but on other hand, this may lead to just too many pages.
+
* Unclassified
 +
**[[Assistance]]
 +
**[[Availability]]
 +
**[[Fading]]
 +
**[[Implicit instruction]]
 +
**[[Scaffolding]]
 +
**[[Accurate knowledge estimates principle]]
  
 
===Learning Processes===
 
===Learning Processes===
  
Here's a (probably incomplete) list of learning processes with entries in the glossary.  These should be used in the "theoretical rationale" section of instructional principles pages.
+
Here's a list of learning processes with entries in the glossary.  These should be used in the "theoretical rationale" section of instructional principles pages. (We should also create a common page structure for them, as we have for instructional principles and studies.)
  
 
[[Co-training]], [[Cognitive headroom]], [[Integration]], [[Refinement]], [[Sense making]], [[self-explanation]]
 
[[Co-training]], [[Cognitive headroom]], [[Integration]], [[Refinement]], [[Sense making]], [[self-explanation]]
  
A potentially different list of learning processes can be found at [[:Category:Learning Processes]].
+
A list of learning processes can also be found at [[:Category:Learning Processes]]. (This list should be the same.)

Latest revision as of 12:47, 8 September 2011

Generalization Hierarchy of Principles

  • Refinement and Fluency
    • Optimized scheduling. Optimized scheduling yields better long-term retention than a practice schedule based on fixed intervals (whether massed or spaced) or intervals self-determined by students (e.g., in flash card use).
    • Feature focusing. Instruction leads to more robust learning when it guides the learner's attention ("focuses") toward relevant features of the material, as opposed to unfocused instruction or instruction that guides attention toward irrelevant features.
  • Sense making
    • Visual-verbal integration. Instruction that includes both visual and verbal information leads to more robust learning than instruction that includes verbal information alone, but only when the instruction supports learners as they coordinate information from both sources and the representations guide student attention to deep features.
    • Example-rule coordination principle. Instruction that combines or helps students' combine learning from examples and learning of or from rules tends to be more effective than instruction that includes the same examples and rules but does not help students combine them.
      • Worked example principle. In contrast to the traditional approach of giving a list homework (or seatwork) problems for students to solve, students learn more efficiently and more robustly when more frequent study of worked examples is interleaved with problem solving practice.
      • Prompted self-explanation principle. When students are given a worked example or text to study, prompting them to self-explain each step of the worked example or each line of the text causes higher learning gains than having them study the material without such prompting.
      • Analogical comparison principle. Analogical comparison can facilitate schema abstraction and transfer of that knowledge to new problem. By comparing the commonalities between two examples, students can focus on the causal structure and improve their learning about the concept.
  • Motivation
    • Personalization. Matching up the features of an instructional event with students' personal interests, experiences, or typical patterns of language use, may lead to more robust learning compared to when instruction is not personalized.



See also Category:Instructional Principle. Other possibilities for principles can be found further below and also at other web sites:

Creating Instructional Principle and Hypothesis Pages

Each instructional principle page is structured with the following headers:

  1. Brief statement of the principle
  2. Description of the principle
    1. Operational definition
    2. Examples
  3. Experimental support
    1. Laboratory experiment support
    2. In vivo experiment support
    3. Level of support (either low, medium, or high) (See the IES practice guide on "Organizing Instruction and Study to Improve Student Learning" for definitions of levels of support.)
  4. Theoretical rationale (these entries should link to one or more learning processes)
  5. Conditions of application
    1. Failed replications (which suggest conditions of application are needed)
  6. Caveats, limitations, open issues, or dissenting views
  7. Variations (descendants)
  8. Generalizations (ascendants)
  9. References

If you have a study page, your hypothesis section should make reference to at least one of these instructional principle pages. You should edit your hypothesis section to be sure it points to an instructional principle page. Then you should edit that instructional principle page so that it at least (1) has the structure above (even if all sections aren't filled in -- a template you can copy is provided further below) and (2) points to your study with a brief summary of the results. You should also (3) read the entry carefully and fill in or edit sections so they are consistent with your findings and with relevant theory.

We want to keep the number of principles down, at least at the highest level of generalization, so try to reference the most general instructional principle that is appropriate. In addition to facilitating our goal of greater shared vocabulary and unification, doing so will also make it so you have less editing work to do! By pointing to more general instructional principles, others will be contributing to structuring and filling in that page in addition to you. You may also point to (from your hypothesis section) more specific instructional principle pages relevant to your study.

Be sure that the *Examples* and *Experimental Support* sections of the instructional principle page you point to also points back to your study page.

Please also add references to literature beyond your own work to the *Reference* section of instructional principles pages you edit. You might simply copy these from your study page's reference section and/or papers you have written. By doing so, you can help others (and others can help you) identify relevant research in the field.

Template

You can copy the following into an instructional principle page you want to edit and then insert existing text into appropriate sections and add text in other sections.

==Brief statement of principle==
==Description of principle==
===Operational definition===
===Examples===
==Experimental support==
===Laboratory experiment support===
===In vivo experiment support===
===Level of support===
==Theoretical rationale== 
(These entries should link to one or more [[:Category:Learning Processes|learning processes]].)
==Conditions of application==
==Caveats, limitations, open issues, or dissenting views==
==Variations (descendants)==
==Generalizations (ascendants)==
==References==
[[Category:Glossary]]
[[Category:Instructional Principle]]

Editing instructional principle pages

An instructional principle is usually so closely related to an independent variable that it is hard to tell them apart. An instructional principle is a general hypothesis, usually about how one instructional method is better than some other baseline or control method. For example, Mayer's multimedia principle states that using diagrams in text (one instructional method) leads to better learning than text alone (another instructional method) under certain circumstances. When a study varies the instructional method, then the instruction method is a kind of independent variable, so in this wiki, they are usually described on independent variable wiki pages. However, an instructional principle is often so closely related to one of its independent variables/methods that the two wiki pages share considerable content. If so, then maybe it would be best to just have one page for both. Use your best judgment.

If you do choose to use separate pages for an instructional principle and a related independent variable, please put "principle" or "hypothesis" in the title of the instructional principle. For instance, the Worked example principle page is different from but related to the worked examples page. The Prompted self-explanation hypothesis page is different from the Prompted Self-explanation page.

Instructional principles are related to the *hypothesis* section of study pages. The hypothesis of a study may be more study- or domain-specific whereas the associated instructional principle will be study-neutral and likely more domain general. Therefore, the wiki page documenting a project or study should have:

  • an independent variables section that refers to the wiki pages of general independent variables. These are found in the column headers of the matrix that appears on your cluster's page.
  • a hypothesis section that refers to the wiki pages of general instructional principles. These instructional principles should reference the general independent variables mentioned above.

If some of the structure above does not exist, please create it.

Candidate Instructional Principles

The following instructional method or independent variable pages are candidates that you might convert to a structured principle page. See directions on structuring a instructional principle or hypothesis page further below.


Learning Processes

Here's a list of learning processes with entries in the glossary. These should be used in the "theoretical rationale" section of instructional principles pages. (We should also create a common page structure for them, as we have for instructional principles and studies.)

Co-training, Cognitive headroom, Integration, Refinement, Sense making, self-explanation

A list of learning processes can also be found at Category:Learning Processes. (This list should be the same.)