Difference between revisions of "Main Page"

From LearnLab
Jump to: navigation, search
m (Reverted edits by Ricko (Talk); changed back to last version by Jbodnar)
(Robust Learning Theoretical Framework)
 
(8 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
== Robust Learning Theoretical Framework ==
 
== Robust Learning Theoretical Framework ==
  
A key goal of PSLC is to support learning scientists in providing explanations of results using, as much as possible, the same core terminology and addressing an accumulating body of precise theoretical [[Instructional Principles and Hypotheses|principles of instruction]].  While a single theory of learning may emerge in the long term, the immediate goal is to encourage researchers to maximize the overlap between each others' theories. We want to help the field get beyond the "[[Toothbrush Problem]]" in theorizing.  
+
A key goal of LearnLab is to support learning scientists in providing explanations of results using, as much as possible, the same core terminology and addressing an accumulating body of precise theoretical [[Instructional Principles and Hypotheses|principles of instruction]].  While a single theory of learning may emerge in the long term, the immediate goal is to encourage researchers to maximize the overlap between each others' theories. We want to help the field get beyond the "[[Toothbrush Problem]]" in theorizing.  
  
In 2006, we drafted a [http://learnlab.org/clusters/PSLC_Theory_Frame_June_15_2006.pdf theoretical framework document] but since then the framework has grown and evolved on this community wiki.
+
In 2012, we published a theoretical framework, called the [http://pact.cs.cmu.edu/pubs/KLI-KoedingerCorbettPerfetti2012-pre.pdf Knowledge-Learning-Instruction (KLI) framework].  This framework builds on our 2006 [http://learnlab.org/clusters/PSLC_Theory_Frame_June_15_2006.pdf theoretical framework document] and, importantly, on the contributions to this wiki. In 2013, we published [http://pact.cs.cmu.edu/pubs/Koedinger-Science-2013.pdf a paper in Science] reviewing instructional principles, the complexity of their combinations, and recommendations for LearnLab style research to address this complexity.
  
In order to display the integration across research projects, this wiki maintains multiple theoretical hierarchies, one of [[Instructional Principles and Hypotheses|Instructional Principles]] and another of empirical studies, which are found on the cluster pages: [[Coordinative Learning]], [[Interactive Communication]], and [[Refinement and Fluency]].
+
The contents of this wiki can be accessed through multiple pathways including 1) an outline of [[Instructional Principles and Hypotheses|Instructional Principles]], 2) a set of early LearnLab research cluster page: [[Coordinative Learning]], [[Interactive Communication]], and [[Refinement and Fluency]], and 3) a later set of LearnLab research thrust pages: [[Cognitive Factors]] [[Metacognition and Motivation]], [[Social Communication]], and [[Computational Modeling and Data Mining]]. See also these summaries: [https://learnlab.org/index.php/cognitive-factors-research-thrust/ Cognitive Factors], [https://learnlab.org/index.php/metacognition-and-motivation-research-thrust/ Metacognition and Motivation], [https://learnlab.org/index.php/social-communication-research-thrust/ Social Communication], and [https://learnlab.org/index.php/computational-modeling-and-data-mining-research-thrust/ Computational Modeling and Data Mining].
  
 
Many other on-line lists of instructional and learning principles exist ['''''please add more!''''']:
 
Many other on-line lists of instructional and learning principles exist ['''''please add more!''''']:
* [http://ies.ed.gov/ncer/pubs/practiceguides/20072004.asp Organizing Instruction and Study to Improve Student Learning], one of the Practice Guides of the Department of Education, Institute for Education Sciences.  See also [http://dww.ed.gov/topic/topic_landing.cfm?PA_ID=9&T_ID=19&Tab=1 the web page "Doing What Works: Psychology of Learning"].
+
* The principles below are summarized in this [https://science.sciencemag.org/content/342/6161/935 Instructional Complexity] paper by LearnLab Director Ken Koedinger and colleagues. Thirty instructional principles are merged from lists below as shown here: [[File:Instructional_Principles_Table.xlsx]]. [http://edugames.design/principles An interactive website] provides a quick overview of these 30 instructional principles.
 +
* [http://ies.ed.gov/ncer/pubs/practiceguides/20072004.asp Organizing Instruction and Study to Improve Student Learning], one of the Practice Guides of the Department of Education, Institute for Education Sciences.  See also:
 +
** [http://www.nctq.org/dmsStage/Learning_About_Learning_Report A web-based update of this guide]
 
* [http://www.psyc.memphis.edu/learning/principles/ Principles of Learning] from Lifelong Learning at Work and at Home, a subgroup of the Association for Psychological Science.
 
* [http://www.psyc.memphis.edu/learning/principles/ Principles of Learning] from Lifelong Learning at Work and at Home, a subgroup of the Association for Psychological Science.
 
* [http://www.edu-design-principles.org Design Principles Database] maintained by the NSF-funded [http://www.telscenter.org/ TELS (Technology Enhanced Learning in Science)] project
 
* [http://www.edu-design-principles.org Design Principles Database] maintained by the NSF-funded [http://www.telscenter.org/ TELS (Technology Enhanced Learning in Science)] project
Line 14: Line 16:
 
* [http://en.wikipedia.org/wiki/Principles_of_learning Wikipedia entry for principles of learning]
 
* [http://en.wikipedia.org/wiki/Principles_of_learning Wikipedia entry for principles of learning]
 
* [http://www.udlcenter.org/aboutudl/udlguidelines Universal Design for Learning guidelines]
 
* [http://www.udlcenter.org/aboutudl/udlguidelines Universal Design for Learning guidelines]
 +
* See a review of principles and the role of technology in refining them in [https://www.youtube.com/watch?v=ysWTEWx9L_A this talk by Art Graesser].
 +
 
   
 
   
 
[http://pact.cs.cmu.edu/koedinger/Koedinger10_WMV%20V9.wmv Ken Koedinger HCII Seminar Talk: Why Designing Effective Learning Interactions Is Not Easy and How We Can Do Better: Part I]
 
[http://pact.cs.cmu.edu/koedinger/Koedinger10_WMV%20V9.wmv Ken Koedinger HCII Seminar Talk: Why Designing Effective Learning Interactions Is Not Easy and How We Can Do Better: Part I]
Line 19: Line 23:
 
=== Toward a Hierarchical Structure of Robust Learning Hypotheses and Findings ===
 
=== Toward a Hierarchical Structure of Robust Learning Hypotheses and Findings ===
  
The structure of the research cluster and study pages is as follows.  When a set of explanations share many terms and hypotheses, we make a node for each explanation, make a node for their common features, and link the nodes so that the common-feature node is the parent of each explanation node.  In most cases a "node" is a single wiki page, but sometimes a node involves several wiki pages.
+
The structure of the research cluster and study pages is as follows (a template can be found at [[Project Page Template and Creation Instructions]]).  When a set of explanations share many terms and hypotheses, we make a node for each explanation, make a node for their common features, and link the nodes so that the common-feature node is the parent of each explanation node.  In most cases a "node" is a single wiki page, but sometimes a node involves several wiki pages.
  
 
In order to more clearly display the integration, each node contains:
 
In order to more clearly display the integration, each node contains:

Latest revision as of 12:48, 5 September 2019

Robust Learning Theoretical Framework

A key goal of LearnLab is to support learning scientists in providing explanations of results using, as much as possible, the same core terminology and addressing an accumulating body of precise theoretical principles of instruction. While a single theory of learning may emerge in the long term, the immediate goal is to encourage researchers to maximize the overlap between each others' theories. We want to help the field get beyond the "Toothbrush Problem" in theorizing.

In 2012, we published a theoretical framework, called the Knowledge-Learning-Instruction (KLI) framework. This framework builds on our 2006 theoretical framework document and, importantly, on the contributions to this wiki. In 2013, we published a paper in Science reviewing instructional principles, the complexity of their combinations, and recommendations for LearnLab style research to address this complexity.

The contents of this wiki can be accessed through multiple pathways including 1) an outline of Instructional Principles, 2) a set of early LearnLab research cluster page: Coordinative Learning, Interactive Communication, and Refinement and Fluency, and 3) a later set of LearnLab research thrust pages: Cognitive Factors Metacognition and Motivation, Social Communication, and Computational Modeling and Data Mining. See also these summaries: Cognitive Factors, Metacognition and Motivation, Social Communication, and Computational Modeling and Data Mining.

Many other on-line lists of instructional and learning principles exist [please add more!]:


Ken Koedinger HCII Seminar Talk: Why Designing Effective Learning Interactions Is Not Easy and How We Can Do Better: Part I

Toward a Hierarchical Structure of Robust Learning Hypotheses and Findings

The structure of the research cluster and study pages is as follows (a template can be found at Project Page Template and Creation Instructions). When a set of explanations share many terms and hypotheses, we make a node for each explanation, make a node for their common features, and link the nodes so that the common-feature node is the parent of each explanation node. In most cases a "node" is a single wiki page, but sometimes a node involves several wiki pages.

In order to more clearly display the integration, each node contains:

  1. An abstract that briefly describes the research encompassed by the node;
  2. A glossary that defines terms used elsewhere in this node but not defined in the nodes that are parents, grandparents, etc. of this node;
  3. The research question stated as concisely as possible, usually in a single sentence;
  4. A background and significance section that briefly summarizes prior work on the research question and why it is important to answer it;
  5. The dependent variables, which are observable and typically measure competence, motivation, interaction, meta-learning, or some other pedagogically desirable outcome;
  6. The independent variables, which typically include instructional environment, activity or method (the instructional "treatment" vs. "control"), and perhaps some student individual difference variables, such as gender or first language;
  7. The hypothesis, which is a concise statement of the relationship among the variables that answers the research question;
  8. The findings, which are the results of the study if it has been performed or the expected findings from the study if it has not -- explicitly indicate if the findings are preliminary;
  9. An explanation that describes the theoretical rationale for the hypothesis using the PSLC theoretical framework. It should be a paragraph or two and provide a causal chain that mentions mediating variables -- unobservable, hypothetical attributes of the students (e.g., knowledge components or path choices), how the treatment affects these, and how they, in turn, affect the dependent variables;
  10. The descendants, which lists links to descendant nodes of this one, if there are any;
  11. A further information section that points to documents using hyper links and/or references in APA format. Each indicates briefly the document's relationship to the node (e.g., whether the document is a paper reporting the node in full detail, a proposal describing the motivation and design of the study in more detail, the node for a similar PSLC research study, etc.).

Experience suggests that the glossaries carry much of the load in explaining the research, and that carefully defining and exemplifying terms often pays off later in reducing confusion and facilitating collaboration. Consequently, the glossaries are sometimes so long that they are spit off as separate wiki pages.

The root node of the hierarchy represents the overarching research question of how to achieve robust learning particularly in academic settings, like K12 schools and colleges. The question is necessarily abstract and is not the sort of question that can actually be tested by a single decisive experiment.

The immediate descendants of the root node are three nodes representing somewhat more specific research questions. There are nodes for each of Coordinative Learning, Interactive Communication and Refinement and Fluency. These present somewhat more concrete research questions. They are specializations to the overarching questions, and form a bridge to testable hypotheses posed by individual research projects.

The leaves of the hierarchy (i.e., nodes with no descendants) represent individual research studies. A leaf node can also represent a group of studies or a whole project if the activities are sufficiently similar that it makes sense to summarize them with a single node. Each leaf node is maintained by its project’s leader and may or may not be publicly accessible depending on the state of the research.

Between the cluster nodes and the leaves, there may be some intervening nodes. For instance, if a group of Coordinative Learning studies all address a similar research question (e.g., how to use verbal and visual instruction together effectively), then a node may be created to summarize their shared aspects. Its parent is the Coordinative Learning cluster node, and its descendants are the relevant project nodes.

For a draft of an alternative framework based on independent dimensions of instruction click here.