https://learnlab.org/wiki/index.php?title=Grading&feed=atom&action=historyGrading - Revision history2024-03-28T19:27:14ZRevision history for this page on the wikiMediaWiki 1.31.12https://learnlab.org/wiki/index.php?title=Grading&diff=10891&oldid=prevAlida: /* Provide a "last attempt" field" in transaction export */2010-08-13T20:08:49Z<p><span dir="auto"><span class="autocomment">Provide a "last attempt" field" in transaction export</span></span></p>
<table class="diff diff-contentalign-left" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 20:08, 13 August 2010</td>
</tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l11" >Line 11:</td>
<td colspan="2" class="diff-lineno">Line 11:</td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Vincent suggested that DataShop simply put a new field in the transaction export to indicate which transaction is the last transaction for a given step.  The researcher would still need to do some work in Excel to produce the actual grades for the students.  But this seems relatively simple for DataShop to do.</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Vincent suggested that DataShop simply put a new field in the transaction export to indicate which transaction is the last transaction for a given step.  The researcher would still need to do some work in Excel to produce the actual grades for the students.  But this seems relatively simple for DataShop to do.</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* "Even if the DataShop is kind enough to implement the "test score" facility, I would hope it will also support the "last attempt" field, which would appear to be even easier to implement (since identifying the last attempt is a step in computing the test score) and provide great bang-for-the-buck.  This field is still very useful for me and the projects that I have been involved with.  For example, it is useful when the standard "test score" analysis is not quite what you need (e.g., when test items depend on each other in certain ways, or when you want more fine-grained measures of test performance, such as transfer v. reproduction - this is very very very typical and endorsed if not required by the PSLC theoretical framework). Further, given that we typically analyze test scores in Excel anyway, and there are typically so many ways to look at test scores, it seems important to offer flexibility (meaning, the "last attempt" field)." -- Vincent email 8/3/2010</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* "Even if the DataShop is kind enough to implement the "test score" facility, I would hope it will also support the "last attempt" field, which would appear to be even easier to implement (since identifying the last attempt is a step in computing the test score) and provide great bang-for-the-buck.  This field is still very useful for me and the projects that I have been involved with.  For example, it is useful when the standard "test score" analysis is not quite what you need (e.g., when test items depend on each other in certain ways, or when you want more fine-grained measures of test performance, such as transfer v. reproduction - this is very very very typical and endorsed if not required by the PSLC theoretical framework). Further, given that we typically analyze test scores in Excel anyway, and there are typically so many ways to look at test scores, it seems important to offer flexibility (meaning, the "last attempt" field)." -- Vincent email 8/3/2010</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>* Related Request: Last Attempts - Test Item :: As a researcher (or educator), I want to see data for last attempts only so I can determine correctness on test items. -- Ruth Wylie, July 3, 2008  </div></td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>* Related Request: Last Attempts - Test Item :: As a researcher (or educator), I want to see data for last attempts only so I can determine correctness on test items. -- Ruth Wylie, July 3, 2008</div></td></tr>
<tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins class="diffchange diffchange-inline">* A "last attempt" field and grading options would definitely be beneficial and something I would frequently use. It would also be very helpful to have DataShop (or this might be on the CTAT-side of things), automatically insert missed steps (per Alida's note on Aug 4, 2010) which might help some of the automatic grading issues? -- Ruth Wylie, email August 12, 2010</ins></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>==== Provide two new fields in the student-step rollup ====</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>==== Provide two new fields in the student-step rollup ====</div></td></tr>
</table>Alidahttps://learnlab.org/wiki/index.php?title=Grading&diff=10855&oldid=prevAlida: /* Grading */2010-08-05T17:39:21Z<p><span dir="auto"><span class="autocomment">Grading</span></span></p>
<table class="diff diff-contentalign-left" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 17:39, 5 August 2010</td>
</tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l20" >Line 20:</td>
<td colspan="2" class="diff-lineno">Line 20:</td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Producing a grade that teachers could use seems difficult.  How would DataShop know how many steps are part of each problem and how many problems are part of a test?  If a student skips a step, and there are no logs for that step, then that student would have less steps than another student. -- [[User:Alida|Alida]] 09:47, 4 August 2010 (EDT)</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Producing a grade that teachers could use seems difficult.  How would DataShop know how many steps are part of each problem and how many problems are part of a test?  If a student skips a step, and there are no logs for that step, then that student would have less steps than another student. -- [[User:Alida|Alida]] 09:47, 4 August 2010 (EDT)</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* It is true that there are a variety of ways one can grade an online test with DataShop log data.  However, I think there are a core of perhaps 4 or 5 different ways it might be done, none of which are particularly complex to implement. I'd suggest a DataShop interface that allows a few variations on grading that the researcher can select and that the DataShop implements.  (And there would still be the possibility of simply using the extra field Vincent has requested, if none of the implemented approaches works.) -- Bruce 8/5/2010</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* It is true that there are a variety of ways one can grade an online test with DataShop log data.  However, I think there are a core of perhaps 4 or 5 different ways it might be done, none of which are particularly complex to implement. I'd suggest a DataShop interface that allows a few variations on grading that the researcher can select and that the DataShop implements.  (And there would still be the possibility of simply using the extra field Vincent has requested, if none of the implemented approaches works.) -- Bruce 8/5/2010</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>* One huge advantage of providing several methods, available in one place (namely, the DataShop) is that the researcher could then rapidly experiment with the results of different grading approaches, ones they may not have tried otherwise, and then decide to grade their online tests differently than originally conceived.  I doubt that this would be done with off-line, ad hoc grading, as things stand now, given the effort to implement different grading approaches for each project separately.  I certainly would use such a facility. <del class="diffchange diffchange-inline">-- Bruce 8/5/2010</del></div></td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins class="diffchange diffchange-inline">*</ins>* One huge advantage of providing several methods, available in one place (namely, the DataShop) is that the researcher could then rapidly experiment with the results of different grading approaches, ones they may not have tried otherwise, and then decide to grade their online tests differently than originally conceived.  I doubt that this would be done with off-line, ad hoc grading, as things stand now, given the effort to implement different grading approaches for each project separately.  I certainly would use such a facility.  </div></td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>* And here is another advantage: Recently, I have had several researchers ask me for the pre-post test scores for my stoich studies.  Since I have always calculated these scores separately and off-line, they are not available in the DataShop. If the DataShop provided a grading mechanism, the scores for all experiments that have online tests could be directly and easily stored with the original data, thus facilitating future research on study data.  <del class="diffchange diffchange-inline">-- Bruce 8/5/2010</del></div></td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins class="diffchange diffchange-inline">*</ins>* And here is another advantage: Recently, I have had several researchers ask me for the pre-post test scores for my stoich studies.  Since I have always calculated these scores separately and off-line, they are not available in the DataShop. If the DataShop provided a grading mechanism, the scores for all experiments that have online tests could be directly and easily stored with the original data, thus facilitating future research on study data.   </div></td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>* Grading approaches I've used on stoich:</div></td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins class="diffchange diffchange-inline">*</ins>* Grading approaches I've used on stoich:</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>** Average all of the steps in the test (pre or post), taking the last submitted value for each step as the "final answer"</div></td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins class="diffchange diffchange-inline">*</ins>** Average all of the steps in the test (pre or post), taking the last submitted value for each step as the "final answer"</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>** Weighted average of all problems (1 problem = X steps), taking the last submitted value for each step as the "final answer"</div></td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins class="diffchange diffchange-inline">*</ins>** Weighted average of all problems (1 problem = X steps), taking the last submitted value for each step as the "final answer"</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div><br></div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div><br></div></td></tr>
</table>Alidahttps://learnlab.org/wiki/index.php?title=Grading&diff=10854&oldid=prevAlida: /* Grading */2010-08-05T17:27:50Z<p><span dir="auto"><span class="autocomment">Grading</span></span></p>
<table class="diff diff-contentalign-left" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 17:27, 5 August 2010</td>
</tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l23" >Line 23:</td>
<td colspan="2" class="diff-lineno">Line 23:</td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* And here is another advantage: Recently, I have had several researchers ask me for the pre-post test scores for my stoich studies.  Since I have always calculated these scores separately and off-line, they are not available in the DataShop. If the DataShop provided a grading mechanism, the scores for all experiments that have online tests could be directly and easily stored with the original data, thus facilitating future research on study data.  -- Bruce 8/5/2010</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* And here is another advantage: Recently, I have had several researchers ask me for the pre-post test scores for my stoich studies.  Since I have always calculated these scores separately and off-line, they are not available in the DataShop. If the DataShop provided a grading mechanism, the scores for all experiments that have online tests could be directly and easily stored with the original data, thus facilitating future research on study data.  -- Bruce 8/5/2010</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Grading approaches I've used on stoich:</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Grading approaches I've used on stoich:</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del class="diffchange diffchange-inline">- </del>Average all of the steps in the test (pre or post), taking the last submitted value for each step as the "final answer"</div></td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins class="diffchange diffchange-inline">** </ins>Average all of the steps in the test (pre or post), taking the last submitted value for each step as the "final answer"</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del class="diffchange diffchange-inline">- </del>Weighted average of all problems (1 problem = X steps), taking the last submitted value for each step as the "final answer"</div></td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins class="diffchange diffchange-inline">** </ins>Weighted average of all problems (1 problem = X steps), taking the last submitted value for each step as the "final answer"</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div><br></div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div><br></div></td></tr>
</table>Alidahttps://learnlab.org/wiki/index.php?title=Grading&diff=10853&oldid=prevBmclaren: /* Grading */2010-08-05T16:09:14Z<p><span dir="auto"><span class="autocomment">Grading</span></span></p>
<table class="diff diff-contentalign-left" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 16:09, 5 August 2010</td>
</tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l22" >Line 22:</td>
<td colspan="2" class="diff-lineno">Line 22:</td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* One huge advantage of providing several methods, available in one place (namely, the DataShop) is that the researcher could then rapidly experiment with the results of different grading approaches, ones they may not have tried otherwise, and then decide to grade their online tests differently than originally conceived.  I doubt that this would be done with off-line, ad hoc grading, as things stand now, given the effort to implement different grading approaches for each project separately.  I certainly would use such a facility. -- Bruce 8/5/2010</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* One huge advantage of providing several methods, available in one place (namely, the DataShop) is that the researcher could then rapidly experiment with the results of different grading approaches, ones they may not have tried otherwise, and then decide to grade their online tests differently than originally conceived.  I doubt that this would be done with off-line, ad hoc grading, as things stand now, given the effort to implement different grading approaches for each project separately.  I certainly would use such a facility. -- Bruce 8/5/2010</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* And here is another advantage: Recently, I have had several researchers ask me for the pre-post test scores for my stoich studies.  Since I have always calculated these scores separately and off-line, they are not available in the DataShop. If the DataShop provided a grading mechanism, the scores for all experiments that have online tests could be directly and easily stored with the original data, thus facilitating future research on study data.  -- Bruce 8/5/2010</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* And here is another advantage: Recently, I have had several researchers ask me for the pre-post test scores for my stoich studies.  Since I have always calculated these scores separately and off-line, they are not available in the DataShop. If the DataShop provided a grading mechanism, the scores for all experiments that have online tests could be directly and easily stored with the original data, thus facilitating future research on study data.  -- Bruce 8/5/2010</div></td></tr>
<tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">* Grading approaches I've used on stoich:</ins></div></td></tr>
<tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">- Average all of the steps in the test (pre or post), taking the last submitted value for each step as the "final answer"</ins></div></td></tr>
<tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">- Weighted average of all problems (1 problem = X steps), taking the last submitted value for each step as the "final answer"</ins></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div><br></div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div><br></div></td></tr>
</table>Bmclarenhttps://learnlab.org/wiki/index.php?title=Grading&diff=10848&oldid=prevBmclaren: /* Grading */2010-08-05T05:53:27Z<p><span dir="auto"><span class="autocomment">Grading</span></span></p>
<table class="diff diff-contentalign-left" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 05:53, 5 August 2010</td>
</tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l20" >Line 20:</td>
<td colspan="2" class="diff-lineno">Line 20:</td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Producing a grade that teachers could use seems difficult.  How would DataShop know how many steps are part of each problem and how many problems are part of a test?  If a student skips a step, and there are no logs for that step, then that student would have less steps than another student. -- [[User:Alida|Alida]] 09:47, 4 August 2010 (EDT)</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Producing a grade that teachers could use seems difficult.  How would DataShop know how many steps are part of each problem and how many problems are part of a test?  If a student skips a step, and there are no logs for that step, then that student would have less steps than another student. -- [[User:Alida|Alida]] 09:47, 4 August 2010 (EDT)</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* It is true that there are a variety of ways one can grade an online test with DataShop log data.  However, I think there are a core of perhaps 4 or 5 different ways it might be done, none of which are particularly complex to implement. I'd suggest a DataShop interface that allows a few variations on grading that the researcher can select and that the DataShop implements.  (And there would still be the possibility of simply using the extra field Vincent has requested, if none of the implemented approaches works.) -- Bruce 8/5/2010</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* It is true that there are a variety of ways one can grade an online test with DataShop log data.  However, I think there are a core of perhaps 4 or 5 different ways it might be done, none of which are particularly complex to implement. I'd suggest a DataShop interface that allows a few variations on grading that the researcher can select and that the DataShop implements.  (And there would still be the possibility of simply using the extra field Vincent has requested, if none of the implemented approaches works.) -- Bruce 8/5/2010</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>* One huge advantage of providing several methods, available in one place (namely, the DataShop) is that the researcher could rapidly experiment with the results of different grading approaches, ones they may not have tried otherwise, and then decide to grade their online tests differently than originally conceived.  I doubt that this would be done with off-line, ad hoc grading, as things stand now.  I certainly would use such a facility. -- Bruce 8/5/2010</div></td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>* One huge advantage of providing several methods, available in one place (namely, the DataShop) is that the researcher could <ins class="diffchange diffchange-inline">then </ins>rapidly experiment with the results of different grading approaches, ones they may not have tried otherwise, and then decide to grade their online tests differently than originally conceived.  I doubt that this would be done with off-line, ad hoc grading, as things stand now<ins class="diffchange diffchange-inline">, given the effort to implement different grading approaches for each project separately</ins>.  I certainly would use such a facility. -- Bruce 8/5/2010</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>* And here is another advantage: Recently, I have had several researchers ask me for <del class="diffchange diffchange-inline">my </del>pre-post test scores for <del class="diffchange diffchange-inline">the </del>stoich studies.  Since I have always calculated these scores separately and off-line, they are not available in the DataShop. If the DataShop provided a grading mechanism, the scores for all experiments that have online tests could be easily stored with the original data, thus facilitating future research on <del class="diffchange diffchange-inline">studies</del>.  -- Bruce 8/5/2010</div></td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>* And here is another advantage: Recently, I have had several researchers ask me for <ins class="diffchange diffchange-inline">the </ins>pre-post test scores for <ins class="diffchange diffchange-inline">my </ins>stoich studies.  Since I have always calculated these scores separately and off-line, they are not available in the DataShop. If the DataShop provided a grading mechanism, the scores for all experiments that have online tests could be <ins class="diffchange diffchange-inline">directly and </ins>easily stored with the original data, thus facilitating future research on <ins class="diffchange diffchange-inline">study data</ins>.  -- Bruce 8/5/2010</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div><br></div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div><br></div></td></tr>
</table>Bmclarenhttps://learnlab.org/wiki/index.php?title=Grading&diff=10847&oldid=prevBmclaren: /* Grading */2010-08-05T05:51:18Z<p><span dir="auto"><span class="autocomment">Grading</span></span></p>
<table class="diff diff-contentalign-left" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 05:51, 5 August 2010</td>
</tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l19" >Line 19:</td>
<td colspan="2" class="diff-lineno">Line 19:</td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* "I think Vincent's idea of adding a new field indicating whether an answer is the last one provided for a particular step is a great start.  However, since it still requires (potentially error-prone) manual manipulation in Excel after exporting the data, why not take it a step further and also provide a DataShop capability to generate a "test score" (and a data file to give to teachers -- that would really help me) from a given set of selections?" -- Bruce email 8/3/2010</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* "I think Vincent's idea of adding a new field indicating whether an answer is the last one provided for a particular step is a great start.  However, since it still requires (potentially error-prone) manual manipulation in Excel after exporting the data, why not take it a step further and also provide a DataShop capability to generate a "test score" (and a data file to give to teachers -- that would really help me) from a given set of selections?" -- Bruce email 8/3/2010</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Producing a grade that teachers could use seems difficult.  How would DataShop know how many steps are part of each problem and how many problems are part of a test?  If a student skips a step, and there are no logs for that step, then that student would have less steps than another student. -- [[User:Alida|Alida]] 09:47, 4 August 2010 (EDT)</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Producing a grade that teachers could use seems difficult.  How would DataShop know how many steps are part of each problem and how many problems are part of a test?  If a student skips a step, and there are no logs for that step, then that student would have less steps than another student. -- [[User:Alida|Alida]] 09:47, 4 August 2010 (EDT)</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>* It is true that there are a variety of ways one can grade an online test with DataShop log data.  However, I think there are a core of perhaps 4 or 5 different ways it might be done, none of which are particularly complex to implement. <del class="diffchange diffchange-inline"> So </del>I'd suggest a DataShop interface that allows a few variations on grading that the researcher can select and that the DataShop implements.  (And there would still be the possibility of simply using the extra field Vincent has requested, if none of the implemented approaches works.) -- Bruce 8/5/2010</div></td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>* It is true that there are a variety of ways one can grade an online test with DataShop log data.  However, I think there are a core of perhaps 4 or 5 different ways it might be done, none of which are particularly complex to implement. I'd suggest a DataShop interface that allows a few variations on grading that the researcher can select and that the DataShop implements.  (And there would still be the possibility of simply using the extra field Vincent has requested, if none of the implemented approaches works.) -- Bruce 8/5/2010</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>* One huge advantage of providing several methods, available in one place (namely, the DataShop) is that the researcher could <del class="diffchange diffchange-inline">then </del>rapidly experiment with the results of different grading approaches, ones they may not have tried otherwise, and then decide to grade their online tests differently than originally conceived. -- Bruce 8/5/2010</div></td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>* One huge advantage of providing several methods, available in one place (namely, the DataShop) is that the researcher could rapidly experiment with the results of different grading approaches, ones they may not have tried otherwise, and then decide to grade their online tests differently than originally conceived. <ins class="diffchange diffchange-inline"> I doubt that this would be done with off-line, ad hoc grading, as things stand now.  I certainly would use such a facility. -- Bruce 8/5/2010</ins></div></td></tr>
<tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins class="diffchange diffchange-inline">* And here is another advantage: Recently, I have had several researchers ask me for my pre-post test scores for the stoich studies.  Since I have always calculated these scores separately and off-line, they are not available in the DataShop. If the DataShop provided a grading mechanism, the scores for all experiments that have online tests could be easily stored with the original data, thus facilitating future research on studies.  </ins>-- Bruce 8/5/2010</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div><br></div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div><br></div></td></tr>
</table>Bmclarenhttps://learnlab.org/wiki/index.php?title=Grading&diff=10846&oldid=prevBmclaren: /* Grading */2010-08-05T05:46:25Z<p><span dir="auto"><span class="autocomment">Grading</span></span></p>
<table class="diff diff-contentalign-left" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 05:46, 5 August 2010</td>
</tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l20" >Line 20:</td>
<td colspan="2" class="diff-lineno">Line 20:</td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Producing a grade that teachers could use seems difficult.  How would DataShop know how many steps are part of each problem and how many problems are part of a test?  If a student skips a step, and there are no logs for that step, then that student would have less steps than another student. -- [[User:Alida|Alida]] 09:47, 4 August 2010 (EDT)</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Producing a grade that teachers could use seems difficult.  How would DataShop know how many steps are part of each problem and how many problems are part of a test?  If a student skips a step, and there are no logs for that step, then that student would have less steps than another student. -- [[User:Alida|Alida]] 09:47, 4 August 2010 (EDT)</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* It is true that there are a variety of ways one can grade an online test with DataShop log data.  However, I think there are a core of perhaps 4 or 5 different ways it might be done, none of which are particularly complex to implement.  So I'd suggest a DataShop interface that allows a few variations on grading that the researcher can select and that the DataShop implements.  (And there would still be the possibility of simply using the extra field Vincent has requested, if none of the implemented approaches works.) -- Bruce 8/5/2010</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* It is true that there are a variety of ways one can grade an online test with DataShop log data.  However, I think there are a core of perhaps 4 or 5 different ways it might be done, none of which are particularly complex to implement.  So I'd suggest a DataShop interface that allows a few variations on grading that the researcher can select and that the DataShop implements.  (And there would still be the possibility of simply using the extra field Vincent has requested, if none of the implemented approaches works.) -- Bruce 8/5/2010</div></td></tr>
<tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">* One huge advantage of providing several methods, available in one place (namely, the DataShop) is that the researcher could then rapidly experiment with the results of different grading approaches, ones they may not have tried otherwise, and then decide to grade their online tests differently than originally conceived. -- Bruce 8/5/2010</ins></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div><br></div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div><br></div></td></tr>
</table>Bmclarenhttps://learnlab.org/wiki/index.php?title=Grading&diff=10845&oldid=prevBmclaren: /* Grading */2010-08-05T05:43:09Z<p><span dir="auto"><span class="autocomment">Grading</span></span></p>
<table class="diff diff-contentalign-left" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 05:43, 5 August 2010</td>
</tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l19" >Line 19:</td>
<td colspan="2" class="diff-lineno">Line 19:</td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* "I think Vincent's idea of adding a new field indicating whether an answer is the last one provided for a particular step is a great start.  However, since it still requires (potentially error-prone) manual manipulation in Excel after exporting the data, why not take it a step further and also provide a DataShop capability to generate a "test score" (and a data file to give to teachers -- that would really help me) from a given set of selections?" -- Bruce email 8/3/2010</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* "I think Vincent's idea of adding a new field indicating whether an answer is the last one provided for a particular step is a great start.  However, since it still requires (potentially error-prone) manual manipulation in Excel after exporting the data, why not take it a step further and also provide a DataShop capability to generate a "test score" (and a data file to give to teachers -- that would really help me) from a given set of selections?" -- Bruce email 8/3/2010</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Producing a grade that teachers could use seems difficult.  How would DataShop know how many steps are part of each problem and how many problems are part of a test?  If a student skips a step, and there are no logs for that step, then that student would have less steps than another student. -- [[User:Alida|Alida]] 09:47, 4 August 2010 (EDT)</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Producing a grade that teachers could use seems difficult.  How would DataShop know how many steps are part of each problem and how many problems are part of a test?  If a student skips a step, and there are no logs for that step, then that student would have less steps than another student. -- [[User:Alida|Alida]] 09:47, 4 August 2010 (EDT)</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>* It is true that there are a variety of ways one <del class="diffchange diffchange-inline">could </del>grade an online test with DataShop log data.  However, I think there are a core of perhaps 4 or 5 different ways it might be done, none of which are particularly complex to implement.  So I'd suggest a DataShop interface that allows a few variations on grading that the researcher can select.  (And there would still be the possibility of simply using the extra field Vincent has requested, if none of the implemented approaches works.) -- Bruce 8/5/2010</div></td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>* It is true that there are a variety of ways one <ins class="diffchange diffchange-inline">can </ins>grade an online test with DataShop log data.  However, I think there are a core of perhaps 4 or 5 different ways it might be done, none of which are particularly complex to implement.  So I'd suggest a DataShop interface that allows a few variations on grading that the researcher can select <ins class="diffchange diffchange-inline">and that the DataShop implements</ins>.  (And there would still be the possibility of simply using the extra field Vincent has requested, if none of the implemented approaches works.) -- Bruce 8/5/2010</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div><br></div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div><br></div></td></tr>
</table>Bmclarenhttps://learnlab.org/wiki/index.php?title=Grading&diff=10844&oldid=prevBmclaren: /* Grading */2010-08-05T05:42:14Z<p><span dir="auto"><span class="autocomment">Grading</span></span></p>
<table class="diff diff-contentalign-left" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 05:42, 5 August 2010</td>
</tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l19" >Line 19:</td>
<td colspan="2" class="diff-lineno">Line 19:</td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* "I think Vincent's idea of adding a new field indicating whether an answer is the last one provided for a particular step is a great start.  However, since it still requires (potentially error-prone) manual manipulation in Excel after exporting the data, why not take it a step further and also provide a DataShop capability to generate a "test score" (and a data file to give to teachers -- that would really help me) from a given set of selections?" -- Bruce email 8/3/2010</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* "I think Vincent's idea of adding a new field indicating whether an answer is the last one provided for a particular step is a great start.  However, since it still requires (potentially error-prone) manual manipulation in Excel after exporting the data, why not take it a step further and also provide a DataShop capability to generate a "test score" (and a data file to give to teachers -- that would really help me) from a given set of selections?" -- Bruce email 8/3/2010</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Producing a grade that teachers could use seems difficult.  How would DataShop know how many steps are part of each problem and how many problems are part of a test?  If a student skips a step, and there are no logs for that step, then that student would have less steps than another student. -- [[User:Alida|Alida]] 09:47, 4 August 2010 (EDT)</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Producing a grade that teachers could use seems difficult.  How would DataShop know how many steps are part of each problem and how many problems are part of a test?  If a student skips a step, and there are no logs for that step, then that student would have less steps than another student. -- [[User:Alida|Alida]] 09:47, 4 August 2010 (EDT)</div></td></tr>
<tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">* It is true that there are a variety of ways one could grade an online test with DataShop log data.  However, I think there are a core of perhaps 4 or 5 different ways it might be done, none of which are particularly complex to implement.  So I'd suggest a DataShop interface that allows a few variations on grading that the researcher can select.  (And there would still be the possibility of simply using the extra field Vincent has requested, if none of the implemented approaches works.) -- Bruce 8/5/2010</ins></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div><br></div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div><br></div></td></tr>
</table>Bmclarenhttps://learnlab.org/wiki/index.php?title=Grading&diff=10837&oldid=prevAlida: /* Provide two new fields in the student-step rollup. */2010-08-04T13:55:50Z<p><span dir="auto"><span class="autocomment">Provide two new fields in the student-step rollup.</span></span></p>
<table class="diff diff-contentalign-left" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 13:55, 4 August 2010</td>
</tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l13" >Line 13:</td>
<td colspan="2" class="diff-lineno">Line 13:</td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Related Request: Last Attempts - Test Item :: As a researcher (or educator), I want to see data for last attempts only so I can determine correctness on test items. -- Ruth Wylie, July 3, 2008  </div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Related Request: Last Attempts - Test Item :: As a researcher (or educator), I want to see data for last attempts only so I can determine correctness on test items. -- Ruth Wylie, July 3, 2008  </div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>==== Provide two new fields in the student-step rollup<del class="diffchange diffchange-inline">. </del>====</div></td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>==== Provide two new fields in the student-step rollup ====</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* DataShop can identify all problems where the tutor_flag field equals, 'test', 'pre-test' or 'post-test'.  Then for each step in that problem, find the last transaction for that step and the outcome (CORRECT vs. INCORRECT) and then put two new columns in the student-step rollup. One column indicating whether the step is part of a test problem.  One column indicating whether the student was right or wrong on the last transaction. -- [[User:Alida|Alida]] 09:52, 4 August 2010 (EDT)</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* DataShop can identify all problems where the tutor_flag field equals, 'test', 'pre-test' or 'post-test'.  Then for each step in that problem, find the last transaction for that step and the outcome (CORRECT vs. INCORRECT) and then put two new columns in the student-step rollup. One column indicating whether the step is part of a test problem.  One column indicating whether the student was right or wrong on the last transaction. -- [[User:Alida|Alida]] 09:52, 4 August 2010 (EDT)</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
</table>Alida