tag:blogger.com,1999:blog-73672520127348202912024-02-20T02:13:17.790-08:00Intelligent AssessmentAnonymoushttp://www.blogger.com/profile/17176522506943755858noreply@blogger.comBlogger8125tag:blogger.com,1999:blog-7367252012734820291.post-55104432369055929012013-06-27T17:28:00.002-07:002013-06-27T17:28:36.342-07:00<div dir="ltr" style="text-align: left;" trbidi="on">
I've been reading (slowly!) the recent report Role of the US Department of education, office of educational technology that is entitled "<i>Expanding evidence approaches for learning in a digital world</i>." (<a href="http://www.ed.gov/edblogs/technology/files/2013/02/Expanding-Evidence-Approaches.pdf">http://www.ed.gov/edblogs/technology/files/2013/02/Expanding-Evidence-Approaches.pdf</a>).<br />
<br />
The development of the report was led by Karen Cator, the Director of the Office of Educational technology. Karen. who was previously at Apple Computers, was involved in the Centre for Assessment and Evaluation of Student Learning (<a href="http://www.caesl.org/">www.caesl.org</a>) for which I was managing director for seven years.<br />
<br />
In Chapter 1 of the report there is an interesting discussion of the A/B testing method, which is a way of rapidly testing changes to the development of online learning materials in an iterative manner. It set me thinking about how educational measurement research needs to change its methodology as we move increasingly into digital formats. Traditionally, in educational research, we have designed large-scale studies that take several years to implement. That is fine for testing the major outcomes of an intervention, but is not an efficient way of making incremental changes that will improve learning in digital environments. We need to think about how we can structure design and development to rapidly try out different versions of assessment methods so that we can identify the most promising ones and focus on those.</div>
Anonymoushttp://www.blogger.com/profile/17176522506943755858noreply@blogger.com0tag:blogger.com,1999:blog-7367252012734820291.post-55877643865769187042013-06-15T22:32:00.001-07:002013-06-15T22:32:58.992-07:00<div dir="ltr" style="text-align: left;" trbidi="on">
Here is a paper from ETS that talks about the current state of the art in automated essay scoring.<br />
<br />
http://www.ets.org/Media/Research/pdf/RD_Connections_21.pdf<br />
<br />
<br /></div>
Anonymoushttp://www.blogger.com/profile/17176522506943755858noreply@blogger.com0tag:blogger.com,1999:blog-7367252012734820291.post-80843895359207437202013-04-30T18:01:00.001-07:002013-04-30T18:01:28.187-07:00<div dir="ltr" style="text-align: left;" trbidi="on">
The debate about automated scoring rages on! This article addresses the issue of the accuracy and validity of computer-scoring of essays and other written responses.<br />
<br />
The thing to remember is that automated scoring applies Natural Language Processing using a variety of algorithms that look for patterns in the responses that correspond to those seen in essays that have been scored by humans. The system has to be trained on some essays rated already by humans, so all it can do is look for features of the answer that correlate to those seen in the human-scored training samples. In other words, they are only as good as the samples they were trained on.<br />
<br />
The other thing to bear in mind is that maybe the best use of the technology is not in high stakes testing, but in supporting teachers in the classroom to relieve their scoring load. Also for online classes like the MOOCs where the student numbers prohibit human scoring.<br />
<br />
I'm sure the debate will continue to rumble on, but automated scoring will improve as machine learning techniques get better and I think that the technologies can be of real help to teachers.<br />
<br />
<a href="https://edge.acer.edu.au/owa/redir.aspx?C=FaFkE9JAJkuXR1ITsSsTM4FPecixF9AIW_j4GnI-MuKBSVsAwbj_vl3u7KD6d33jAKdq_8zRld0.&URL=http%3a%2f%2fwww.google.com%2furl%3fsa%3dX%26q%3dhttp%3a%2f%2fwww.pcauthority.com.au%2fFeature%2f341475%2ccomputer-says-no-automated-essay-grading-in-the-world-of-moocs.aspx%26ct%3dga%26cad%3dCAEQAhgAIAAoATABOAFAr5n9iwVIAVAAWABiBWVuLUFV%26cd%3dxzagFWnFfLs%26usg%3dAFQjCNHp38TvHG2HQtgIA9a2mLyCT2DEJg" style="font-family: 'Times New Roman', serif; font-size: 15.555556297302246px;" target="_blank"><span style="color: #1111cc;">Computer says no: automated essay grading in the world of MOOCs</span></a><br style="font-family: 'Times New Roman', serif; font-size: 15.555556297302246px;" /><span style="color: #777777; font-family: 'Times New Roman', serif; font-size: x-small;"><span style="font-size: 10pt;">PC Authority</span></span><span style="font-family: 'Times New Roman', serif; font-size: x-small;"><span style="font-size: 10pt;"><br /></span></span><span style="font-family: 'Times New Roman', serif; font-size: x-small;"><span style="font-size: 10pt;"><b>ETS</b></span></span><span style="font-family: 'Times New Roman', serif; font-size: x-small;"><span style="font-size: 10pt;"> uses the e-Rater software, in conjunction with human assessors, to grade the Graduate Record Examinations (GRE) and Test Of English as a Foreign Language (TOEFL), without human intervention for practice tests. Both these tests are high stakes – the </span></span><span style="font-family: 'Times New Roman', serif; font-size: x-small;"><span style="font-size: 10pt;"><b>...</b></span></span><span style="font-family: 'Times New Roman', serif; font-size: x-small;"><span style="font-size: 10pt;"><br /></span></span><br />
<br /></div>
Anonymoushttp://www.blogger.com/profile/17176522506943755858noreply@blogger.com0tag:blogger.com,1999:blog-7367252012734820291.post-28383318105745773292013-04-27T10:57:00.001-07:002013-04-27T10:57:56.482-07:00<div dir="ltr" style="text-align: left;" trbidi="on">
Questioning the System<br />
<br />
A colleague sent me a link to this video in which Sullibreezy questions the education system and the value of exams<br />
<br />
<br style="font-family: 'Segoe UI', Helvetica, Arial, sans-serif;" /><b style="font-family: 'Segoe UI', Helvetica, Arial, sans-serif;">I Will Not Let An Exam Result Decide My Fate||Spoken Word</b><br style="font-family: 'Segoe UI', Helvetica, Arial, sans-serif;" /><a href="https://edge.acer.edu.au/owa/redir.aspx?C=yYdT4WkxCEiWd6jI4N_2_rwq-bX7EdAIsOewOGE7FbHIaDzvdALmF-OnKGDFdV74PHB2wBNWfDo.&URL=http%3a%2f%2fwww.youtube.com%2fwatch%3fv%3dD-eVF_G_p-Y" style="font-family: 'Segoe UI', Helvetica, Arial, sans-serif;" target="_blank">http://www.youtube.com/watch?v=D-eVF_G_p-Y</a><br />
<br />
He raises some valid points about the purpose of education and the way that we assess learning. I like his questioning of why we treat all students as if they are the same when they differ greatly in their strengths and weaknesses. The question he doesn't answer is what should education be in the future. That is for us to decide.</div>
Anonymoushttp://www.blogger.com/profile/17176522506943755858noreply@blogger.com0tag:blogger.com,1999:blog-7367252012734820291.post-75044237541335070532013-04-11T22:15:00.001-07:002013-04-11T22:15:46.387-07:00<div dir="ltr" style="text-align: left;" trbidi="on">
<!--[if gte mso 9]><xml>
<o:DocumentProperties>
<o:Revision>0</o:Revision>
<o:TotalTime>0</o:TotalTime>
<o:Pages>1</o:Pages>
<o:Words>177</o:Words>
<o:Characters>1015</o:Characters>
<o:Company>ACER</o:Company>
<o:Lines>8</o:Lines>
<o:Paragraphs>2</o:Paragraphs>
<o:CharactersWithSpaces>1190</o:CharactersWithSpaces>
<o:Version>14.0</o:Version>
</o:DocumentProperties>
<o:OfficeDocumentSettings>
<o:TargetScreenSize>544x376</o:TargetScreenSize>
</o:OfficeDocumentSettings>
</xml><![endif]-->
<!--[if gte mso 9]><xml>
<w:WordDocument>
<w:View>Normal</w:View>
<w:Zoom>0</w:Zoom>
<w:TrackMoves/>
<w:TrackFormatting/>
<w:PunctuationKerning/>
<w:ValidateAgainstSchemas/>
<w:SaveIfXMLInvalid>false</w:SaveIfXMLInvalid>
<w:IgnoreMixedContent>false</w:IgnoreMixedContent>
<w:AlwaysShowPlaceholderText>false</w:AlwaysShowPlaceholderText>
<w:DoNotPromoteQF/>
<w:LidThemeOther>EN-AU</w:LidThemeOther>
<w:LidThemeAsian>JA</w:LidThemeAsian>
<w:LidThemeComplexScript>X-NONE</w:LidThemeComplexScript>
<w:Compatibility>
<w:BreakWrappedTables/>
<w:SnapToGridInCell/>
<w:WrapTextWithPunct/>
<w:UseAsianBreakRules/>
<w:DontGrowAutofit/>
<w:SplitPgBreakAndParaMark/>
<w:EnableOpenTypeKerning/>
<w:DontFlipMirrorIndents/>
<w:OverrideTableStyleHps/>
</w:Compatibility>
<m:mathPr>
<m:mathFont m:val="Cambria Math"/>
<m:brkBin m:val="before"/>
<m:brkBinSub m:val="--"/>
<m:smallFrac m:val="off"/>
<m:dispDef/>
<m:lMargin m:val="0"/>
<m:rMargin m:val="0"/>
<m:defJc m:val="centerGroup"/>
<m:wrapIndent m:val="1440"/>
<m:intLim m:val="subSup"/>
<m:naryLim m:val="undOvr"/>
</m:mathPr></w:WordDocument>
</xml><![endif]--><!--[if gte mso 9]><xml>
<w:LatentStyles DefLockedState="false" DefUnhideWhenUsed="true"
DefSemiHidden="true" DefQFormat="false" DefPriority="99"
LatentStyleCount="276">
<w:LsdException Locked="false" Priority="0" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Normal"/>
<w:LsdException Locked="false" Priority="9" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="heading 1"/>
<w:LsdException Locked="false" Priority="9" QFormat="true" Name="heading 2"/>
<w:LsdException Locked="false" Priority="9" QFormat="true" Name="heading 3"/>
<w:LsdException Locked="false" Priority="9" QFormat="true" Name="heading 4"/>
<w:LsdException Locked="false" Priority="9" QFormat="true" Name="heading 5"/>
<w:LsdException Locked="false" Priority="9" QFormat="true" Name="heading 6"/>
<w:LsdException Locked="false" Priority="9" QFormat="true" Name="heading 7"/>
<w:LsdException Locked="false" Priority="9" QFormat="true" Name="heading 8"/>
<w:LsdException Locked="false" Priority="9" QFormat="true" Name="heading 9"/>
<w:LsdException Locked="false" Priority="39" Name="toc 1"/>
<w:LsdException Locked="false" Priority="39" Name="toc 2"/>
<w:LsdException Locked="false" Priority="39" Name="toc 3"/>
<w:LsdException Locked="false" Priority="39" Name="toc 4"/>
<w:LsdException Locked="false" Priority="39" Name="toc 5"/>
<w:LsdException Locked="false" Priority="39" Name="toc 6"/>
<w:LsdException Locked="false" Priority="39" Name="toc 7"/>
<w:LsdException Locked="false" Priority="39" Name="toc 8"/>
<w:LsdException Locked="false" Priority="39" Name="toc 9"/>
<w:LsdException Locked="false" Priority="35" QFormat="true" Name="caption"/>
<w:LsdException Locked="false" Priority="10" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Title"/>
<w:LsdException Locked="false" Priority="0" Name="Default Paragraph Font"/>
<w:LsdException Locked="false" Priority="11" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Subtitle"/>
<w:LsdException Locked="false" Priority="22" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Strong"/>
<w:LsdException Locked="false" Priority="20" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Emphasis"/>
<w:LsdException Locked="false" Priority="59" SemiHidden="false"
UnhideWhenUsed="false" Name="Table Grid"/>
<w:LsdException Locked="false" UnhideWhenUsed="false" Name="Placeholder Text"/>
<w:LsdException Locked="false" Priority="1" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="No Spacing"/>
<w:LsdException Locked="false" Priority="60" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Shading"/>
<w:LsdException Locked="false" Priority="61" SemiHidden="false"
UnhideWhenUsed="false" Name="Light List"/>
<w:LsdException Locked="false" Priority="62" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Grid"/>
<w:LsdException Locked="false" Priority="63" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 1"/>
<w:LsdException Locked="false" Priority="64" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 2"/>
<w:LsdException Locked="false" Priority="65" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 1"/>
<w:LsdException Locked="false" Priority="66" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 2"/>
<w:LsdException Locked="false" Priority="67" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 1"/>
<w:LsdException Locked="false" Priority="68" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 2"/>
<w:LsdException Locked="false" Priority="69" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 3"/>
<w:LsdException Locked="false" Priority="70" SemiHidden="false"
UnhideWhenUsed="false" Name="Dark List"/>
<w:LsdException Locked="false" Priority="71" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Shading"/>
<w:LsdException Locked="false" Priority="72" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful List"/>
<w:LsdException Locked="false" Priority="73" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Grid"/>
<w:LsdException Locked="false" Priority="60" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Shading Accent 1"/>
<w:LsdException Locked="false" Priority="61" SemiHidden="false"
UnhideWhenUsed="false" Name="Light List Accent 1"/>
<w:LsdException Locked="false" Priority="62" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Grid Accent 1"/>
<w:LsdException Locked="false" Priority="63" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 1 Accent 1"/>
<w:LsdException Locked="false" Priority="64" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 2 Accent 1"/>
<w:LsdException Locked="false" Priority="65" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 1 Accent 1"/>
<w:LsdException Locked="false" UnhideWhenUsed="false" Name="Revision"/>
<w:LsdException Locked="false" Priority="34" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="List Paragraph"/>
<w:LsdException Locked="false" Priority="29" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Quote"/>
<w:LsdException Locked="false" Priority="30" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Intense Quote"/>
<w:LsdException Locked="false" Priority="66" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 2 Accent 1"/>
<w:LsdException Locked="false" Priority="67" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 1 Accent 1"/>
<w:LsdException Locked="false" Priority="68" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 2 Accent 1"/>
<w:LsdException Locked="false" Priority="69" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 3 Accent 1"/>
<w:LsdException Locked="false" Priority="70" SemiHidden="false"
UnhideWhenUsed="false" Name="Dark List Accent 1"/>
<w:LsdException Locked="false" Priority="71" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Shading Accent 1"/>
<w:LsdException Locked="false" Priority="72" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful List Accent 1"/>
<w:LsdException Locked="false" Priority="73" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Grid Accent 1"/>
<w:LsdException Locked="false" Priority="60" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Shading Accent 2"/>
<w:LsdException Locked="false" Priority="61" SemiHidden="false"
UnhideWhenUsed="false" Name="Light List Accent 2"/>
<w:LsdException Locked="false" Priority="62" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Grid Accent 2"/>
<w:LsdException Locked="false" Priority="63" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 1 Accent 2"/>
<w:LsdException Locked="false" Priority="64" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 2 Accent 2"/>
<w:LsdException Locked="false" Priority="65" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 1 Accent 2"/>
<w:LsdException Locked="false" Priority="66" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 2 Accent 2"/>
<w:LsdException Locked="false" Priority="67" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 1 Accent 2"/>
<w:LsdException Locked="false" Priority="68" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 2 Accent 2"/>
<w:LsdException Locked="false" Priority="69" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 3 Accent 2"/>
<w:LsdException Locked="false" Priority="70" SemiHidden="false"
UnhideWhenUsed="false" Name="Dark List Accent 2"/>
<w:LsdException Locked="false" Priority="71" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Shading Accent 2"/>
<w:LsdException Locked="false" Priority="72" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful List Accent 2"/>
<w:LsdException Locked="false" Priority="73" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Grid Accent 2"/>
<w:LsdException Locked="false" Priority="60" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Shading Accent 3"/>
<w:LsdException Locked="false" Priority="61" SemiHidden="false"
UnhideWhenUsed="false" Name="Light List Accent 3"/>
<w:LsdException Locked="false" Priority="62" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Grid Accent 3"/>
<w:LsdException Locked="false" Priority="63" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 1 Accent 3"/>
<w:LsdException Locked="false" Priority="64" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 2 Accent 3"/>
<w:LsdException Locked="false" Priority="65" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 1 Accent 3"/>
<w:LsdException Locked="false" Priority="66" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 2 Accent 3"/>
<w:LsdException Locked="false" Priority="67" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 1 Accent 3"/>
<w:LsdException Locked="false" Priority="68" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 2 Accent 3"/>
<w:LsdException Locked="false" Priority="69" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 3 Accent 3"/>
<w:LsdException Locked="false" Priority="70" SemiHidden="false"
UnhideWhenUsed="false" Name="Dark List Accent 3"/>
<w:LsdException Locked="false" Priority="71" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Shading Accent 3"/>
<w:LsdException Locked="false" Priority="72" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful List Accent 3"/>
<w:LsdException Locked="false" Priority="73" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Grid Accent 3"/>
<w:LsdException Locked="false" Priority="60" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Shading Accent 4"/>
<w:LsdException Locked="false" Priority="61" SemiHidden="false"
UnhideWhenUsed="false" Name="Light List Accent 4"/>
<w:LsdException Locked="false" Priority="62" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Grid Accent 4"/>
<w:LsdException Locked="false" Priority="63" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 1 Accent 4"/>
<w:LsdException Locked="false" Priority="64" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 2 Accent 4"/>
<w:LsdException Locked="false" Priority="65" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 1 Accent 4"/>
<w:LsdException Locked="false" Priority="66" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 2 Accent 4"/>
<w:LsdException Locked="false" Priority="67" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 1 Accent 4"/>
<w:LsdException Locked="false" Priority="68" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 2 Accent 4"/>
<w:LsdException Locked="false" Priority="69" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 3 Accent 4"/>
<w:LsdException Locked="false" Priority="70" SemiHidden="false"
UnhideWhenUsed="false" Name="Dark List Accent 4"/>
<w:LsdException Locked="false" Priority="71" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Shading Accent 4"/>
<w:LsdException Locked="false" Priority="72" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful List Accent 4"/>
<w:LsdException Locked="false" Priority="73" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Grid Accent 4"/>
<w:LsdException Locked="false" Priority="60" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Shading Accent 5"/>
<w:LsdException Locked="false" Priority="61" SemiHidden="false"
UnhideWhenUsed="false" Name="Light List Accent 5"/>
<w:LsdException Locked="false" Priority="62" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Grid Accent 5"/>
<w:LsdException Locked="false" Priority="63" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 1 Accent 5"/>
<w:LsdException Locked="false" Priority="64" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 2 Accent 5"/>
<w:LsdException Locked="false" Priority="65" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 1 Accent 5"/>
<w:LsdException Locked="false" Priority="66" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 2 Accent 5"/>
<w:LsdException Locked="false" Priority="67" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 1 Accent 5"/>
<w:LsdException Locked="false" Priority="68" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 2 Accent 5"/>
<w:LsdException Locked="false" Priority="69" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 3 Accent 5"/>
<w:LsdException Locked="false" Priority="70" SemiHidden="false"
UnhideWhenUsed="false" Name="Dark List Accent 5"/>
<w:LsdException Locked="false" Priority="71" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Shading Accent 5"/>
<w:LsdException Locked="false" Priority="72" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful List Accent 5"/>
<w:LsdException Locked="false" Priority="73" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Grid Accent 5"/>
<w:LsdException Locked="false" Priority="60" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Shading Accent 6"/>
<w:LsdException Locked="false" Priority="61" SemiHidden="false"
UnhideWhenUsed="false" Name="Light List Accent 6"/>
<w:LsdException Locked="false" Priority="62" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Grid Accent 6"/>
<w:LsdException Locked="false" Priority="63" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 1 Accent 6"/>
<w:LsdException Locked="false" Priority="64" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 2 Accent 6"/>
<w:LsdException Locked="false" Priority="65" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 1 Accent 6"/>
<w:LsdException Locked="false" Priority="66" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 2 Accent 6"/>
<w:LsdException Locked="false" Priority="67" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 1 Accent 6"/>
<w:LsdException Locked="false" Priority="68" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 2 Accent 6"/>
<w:LsdException Locked="false" Priority="69" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 3 Accent 6"/>
<w:LsdException Locked="false" Priority="70" SemiHidden="false"
UnhideWhenUsed="false" Name="Dark List Accent 6"/>
<w:LsdException Locked="false" Priority="71" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Shading Accent 6"/>
<w:LsdException Locked="false" Priority="72" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful List Accent 6"/>
<w:LsdException Locked="false" Priority="73" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Grid Accent 6"/>
<w:LsdException Locked="false" Priority="19" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Subtle Emphasis"/>
<w:LsdException Locked="false" Priority="21" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Intense Emphasis"/>
<w:LsdException Locked="false" Priority="31" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Subtle Reference"/>
<w:LsdException Locked="false" Priority="32" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Intense Reference"/>
<w:LsdException Locked="false" Priority="33" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Book Title"/>
<w:LsdException Locked="false" Priority="37" Name="Bibliography"/>
<w:LsdException Locked="false" Priority="39" QFormat="true" Name="TOC Heading"/>
</w:LatentStyles>
</xml><![endif]-->
<!--[if gte mso 10]>
<style>
/* Style Definitions */
table.MsoNormalTable
{mso-style-name:"Table Normal";
mso-tstyle-rowband-size:0;
mso-tstyle-colband-size:0;
mso-style-noshow:yes;
mso-style-priority:99;
mso-style-parent:"";
mso-padding-alt:0cm 5.4pt 0cm 5.4pt;
mso-para-margin:0cm;
mso-para-margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:10.0pt;
font-family:"Times New Roman";}
</style>
<![endif]-->
<!--StartFragment-->
<br />
<div class="Body1">
A couple of days ago I was sitting in on the educational technology strand sessions of the 2013 NARST
conference and getting frustrated!</div>
<div class="Body1">
<br /></div>
<div class="Body1">
A wonderful thing that is happening is that
many researchers are developing interactive learning and serious gaming
environments that are teaching kids to develop content knowledge and skills in
science. And they are collecting oodles of log data from those environments. </div>
<div class="Body1">
<br /></div>
<div class="Body1">
The other good thing is that they are aware that they need to be assessing the
learning as the kids go through the experience, but most are not well informed
about how to do so. I keep seeing people trying to find the patterns of
learning in the data to determine where they should embed assessments and what
those should be measuring. </div>
<div class="Body1">
<br /></div>
<div class="Body1">
I wish that more of them would be thinking about
assessment using the Evidence Centred Design (ECD) approach. If they thought
about what they want kids to know and be able to do, then determine what
evidence they would accept that students have those knowledge and skills, and
then design tasks that will elicit that kind of evidence. Then they wouldn't
need to be data mining to find out what to measure. They need educational
measurement experts in their projects! <span style="color: windowtext; font-family: "Times New Roman"; font-size: 10.0pt; mso-ansi-language: #0400; mso-bidi-language: X-NONE; mso-fareast-font-family: "Times New Roman"; mso-fareast-language: #0400;"><o:p></o:p></span></div>
<!--EndFragment--></div>
Anonymoushttp://www.blogger.com/profile/17176522506943755858noreply@blogger.com0tag:blogger.com,1999:blog-7367252012734820291.post-82814552132058894692013-03-14T20:17:00.002-07:002013-03-14T20:17:57.049-07:00<div dir="ltr" style="text-align: left;" trbidi="on">
There is a new report issued in the US by the Gordon Commission (details below with links to the report). It is interesting to see what they are saying about the changing face of education assessment. There are some great thinkers on the commission including Bob Mislevy, John Behrens and Randy Bennett.<br />
<br />
<span style="background-color: white; font-family: Helvetica, Arial, sans-serif; font-size: 13px; line-height: 15px;">The Gordon Commission on the Future of Assessment in Education, established by </span><br style="background-color: white; font-family: Helvetica, Arial, sans-serif; font-size: 13px; line-height: 15px;" /><span style="background-color: white; font-family: Helvetica, Arial, sans-serif; font-size: 13px; line-height: 15px;">ETS in January 2011 and given a two-year tenure, has released a public policy statement calling upon state and federal policymakers to commit to a long-term effort to develop assessments that place greater emphasis on providing timely and valuable information to students and teachers. See:</span><a href="http://www.linkedin.com/redirect?url=http%3A%2F%2Fwww%2Egordoncommission%2Eorg%2Frsc%2Fpdfs%2Fgordon_commission_public_policy_report%2Epdf&urlhash=e91b&_t=tracking_anet" rel="nofollow" style="background-color: white; border: 0px; color: #006699; font-family: Helvetica, Arial, sans-serif; font-size: 13px; line-height: 15px; margin: 0px; outline: 0px; padding: 0px; text-decoration: none; vertical-align: baseline;" target="blank">http://www.gordoncommission.org/rsc/pdfs/gordon_commission_public_policy_report.pdf</a><span style="background-color: white; font-family: Helvetica, Arial, sans-serif; font-size: 13px; line-height: 15px;">. </span><br style="background-color: white; font-family: Helvetica, Arial, sans-serif; font-size: 13px; line-height: 15px;" /><span style="background-color: white; font-family: Helvetica, Arial, sans-serif; font-size: 13px; line-height: 15px;">See also the technical report TO ASSESS, TO TEACH, TO LEARN: A VISION FOR THE THE FUTURE OF ASSESSEMENT:</span><a href="http://www.linkedin.com/redirect?url=http%3A%2F%2Fwww%2Egordoncommission%2Eorg%2Frsc%2Fpdfs%2Fgordon_commission_technical_report%2Epdf&urlhash=maHG&_t=tracking_anet" rel="nofollow" style="background-color: white; border: 0px; color: #006699; font-family: Helvetica, Arial, sans-serif; font-size: 13px; line-height: 15px; margin: 0px; outline: 0px; padding: 0px; text-decoration: none; vertical-align: baseline;" target="blank">http://www.gordoncommission.org/rsc/pdfs/gordon_commission_technical_report.pdf</a><span style="background-color: white; font-family: Helvetica, Arial, sans-serif; font-size: 13px; line-height: 15px;"> </span><br style="background-color: white; font-family: Helvetica, Arial, sans-serif; font-size: 13px; line-height: 15px;" /><span style="background-color: white; font-family: Helvetica, Arial, sans-serif; font-size: 13px; line-height: 15px;">and its Executive Summary</span><a href="http://www.linkedin.com/redirect?url=http%3A%2F%2Fwww%2Egordoncommission%2Eorg%2Frsc%2Fpdfs%2Ftechnical_report_executive_summary%2Epdf&urlhash=V5Kt&_t=tracking_anet" rel="nofollow" style="background-color: white; border: 0px; color: #006699; font-family: Helvetica, Arial, sans-serif; font-size: 13px; line-height: 15px; margin: 0px; outline: 0px; padding: 0px; text-decoration: none; vertical-align: baseline;" target="blank">http://www.gordoncommission.org/rsc/pdfs/technical_report_executive_summary.pdf</a><span style="background-color: white; font-family: Helvetica, Arial, sans-serif; font-size: 13px; line-height: 15px;">. </span></div>
Anonymoushttp://www.blogger.com/profile/17176522506943755858noreply@blogger.com0tag:blogger.com,1999:blog-7367252012734820291.post-35715175350116024512013-02-28T14:51:00.001-08:002013-02-28T14:51:32.259-08:00<div dir="ltr" style="text-align: left;" trbidi="on">
The promise of technology for education is that it can enable personalisation of learning. By that I mean that it will allow sequences of learning to be recommended for individual learners and that during the learning, a student's progress will be monitored and evaluated so that assistance can be given at the right time. At the end of the learning sequence, the student and her teacher will receive reports of what she has learned, with recommendations for next steps.<br />
<br />
BUT, none of this is possible without assessment of learning both at the macro level (courses and sequences of instruction) combined with micro level assessments of what the student knows and can do right now (to allow for tutoring).<br />
<br />
In this blog I want to explore the barriers and opportunities in this space.</div>
Anonymoushttp://www.blogger.com/profile/17176522506943755858noreply@blogger.com0tag:blogger.com,1999:blog-7367252012734820291.post-36142358511718919402013-02-25T18:56:00.001-08:002013-02-25T19:35:31.517-08:00<div dir="ltr" style="text-align: left;" trbidi="on">
<span style="font-family: Verdana, sans-serif;">I started this blog to muse about the evolving world of intelligent assessment, which is about assessing learning in electronic learning environments. However, knowing me, I'll probably stray off into other related topics as it evolves...</span><br />
<span style="font-family: Verdana, sans-serif;"><br /></span>
<span style="font-family: Verdana, sans-serif;">Here's a TED video that a friend and colleague reminded me about at the weekend, in which Daphne Koller talks about Coursera. Towards the end she talks about personalisation of learning which is what intelligent assessment is all about - Enjoy!</span><br />
<span style="font-family: Verdana, sans-serif;"><br /></span>
<br />
<div class="p1">
<a href="http://www.ted.com/talks/daphne_koller_what_we_re_learning_from_online_education.html??utm_medium=social&source=email&utm_source=email&utm_campaign=ios-share">Daphne Koller: What we're learning from online education</a></div>
</div>
Anonymoushttp://www.blogger.com/profile/17176522506943755858noreply@blogger.com0