Download User Manual DoneIT
Transcript
'RQH,7 7KHILUVWXVHUPDQXDOIRUSURWRW\SH 9HUVLRQ &RQWUDFW//312.$.$03 Table of Contents TableofContents....................................................................................................0 Disclaimer....................................................................................................................2 Installation..................................................................................................................3 Introduction................................................................................................................3 Useraccounts..............................................................................................................3 Login............................................................................................................................4 Themenusystem....................................................................................................4 Networkstatus........................................................................................................5 Creatinganassessment..............................................................................................5 Stepone,metadata.............................................................................................5 Editassessmentsetupfile...........................................................................................8 Simulation(Themonkeycage).................................................................................11 Saveandload............................................................................................................11 Letsstart...................................................................................................................11 Studentinterfaceonlogin........................................................................................12 Monitoringanassessment........................................................................................14 Analyzingtheresults.................................................................................................16 WorkingInClass........................................................................................................17 Results.......................................................................................................................20 Disclaimer Version1.1.688isaprototype!!Weknowthattherestillareerrorstofix,butthe applicationshouldrunandbeabletouseforsimpleassessments,withanSRS activityaftertheassessment.Anybugscanbereportedto Trond.M.Thorseth@hist.noandpleasegivetheversionnumber.Asbugsarefixed, newversionswillarriveandthisisthenumberusedtokeeptrackofbugsandbug fixes. Warning!Whereweseechanges comingorproblemsthatmight appear,thisisnotifiedthisway.You seethesebarswithamessage between.Thismanualdescribesa prototypeinconstantchange!!! Installation DoneITCisAirapplicationthatrequiresAdobeAirinstalledonyourcomputer.You getadobeairfromAdobeforfree.Youcangetitfrom http://get.adobe.com/air/ WhenAirisinstalled,the.airapplicationcanbeinstalledbysimplydoubleclicking onthe.airfile.Ifyouhaveapreviousversioninstalled,youhavetoremovetheold versionofDoneITCbeforeinstallinganewone. OnceinstalledyouwillgettheDoneITCicononyourdesktop. Introduction TheDoneITassessmentsystemisageneralassessmentsystemmadeforconnecting assessmentsbutwithanapproachwherewetrytotargetlearning.Thefocusisto providetheteacherwithenoughinformationfromtheassessmentpart,tobeable toperformanactivityimmediatelyafterwards,thattargetsproblemsidentified fromtheassessment.Cantheimmediatefeedbackprovidedandthewayateacher decidestoworkwiththeresults,provideanarenaforlearningusingtheresults fromtheassessment? Theapplicationmainlydoesthefollowing: x x x x x x Logintotheassessmentserver,andprovidesaninterfacewherethe teachercangetanoverviewofassessmentsandtosomeextent, administrateassessments. Aninterfaceprovidingtoolstocreateassessmentsthatisinterpretedby theserversuchthatthestudentscanrespondtotheassessment.The assessmentsetupcanbesavedorloadedfromfilelocally. Aninterfaceforclosetolivemonitoringofanactiveassessmentand considerationoftheresultswhilethestudentsareresponding. Providesaninterfaceforconsideringtheresultsandselectwhatquestions toworkwithinthePostAssessmentActivity. Aninterfaceforperformingapostassessmentactivity,displayingpartlyor completelyresultsorsendingthequestionbackforanewsecondchance response. Anadmininterfacewheretheresultsaresummarizedandcanbeexported toExcel. User accounts. Youcanatthemomentusethegeneralusernameteacherwiththepassword teacher.Youcancreateyourownusername,Werecommendthatyoudoso!! UsingawebbrowserlikeGoogleChromeandgotothefollowingaddress:Youwill berequiredtogiveausernameandpassword(teacher,teacher) http://aftͲtest.hist.no/srsͲassessment/admin/accounts/ Hereyoucancreateyourownusernameandgiveittheroleasateacher.Ifyou wanttogeneratestudentaccounts,thisistemporarilydonehereoryoucanallow studentstocreatetheirindividualusers,at http:///aftͲtest.hiist.no/srsͲͲassessment/userreggistration Thislinkissnotpassworrdprotected,b butcanonlyb beusedtogen neratestudenttusers. Login Thefirsttthingyouhaveetodoistolo ogintoaserveer.Atthemom mentweonlyh have oneserveeronlinethatyyoucanlogon nto,aftͲtest.h hist.no,thatistheonlyoptio onyou haveinth helogininterfaace. Ifyouhavveausernameeandpassworrdusethat,otherwiseuseu username;“teacher” andpassw word;“teacher”.Ifyouhavvealocalhostiinstallation,ch heckthelocalhost andlogon n.Whenthesserveraddressspointstoareealserver,thaatisonline,yo ougeta greensym mbolindicatinggthattheservverisaliveand dresponding.Clickconnecctand youenterrtheapplicatio onandgetanoverviewofaallyouassessm mentsessionsonthe server. Warning!Theservverisstillunder deveelopmentandyoumightfin ndthat yourrassessmenth hasdisappeareed.If thesserverhasbeeenrestarted,aall assessmentsonth heserverare perm manentlydeletted! Figure2Theeinitialinterfacew whereyougetalllyoursessionslissted.Hereyoucan nloginandgetth heresults, monitoraseession,orswitchsession. Hereyoucannowgoandmonitoran nexistingasseessment,orgo oandlookattthe nandcloseth he resultsoftheassessmeent.Inthefutureyouwillbeabletoopen heassessmentt.Nowyouw willgetonlya assessment,activateorrdeactivateth ureisnotimpllemented.Theedeleteassessmentisnot messagetthatthisfeatu activatedatthemoment. The me enu system m. Themainmenuisasim mplesetofstepsthatfollow wsanormalprocedure.AfteerLogin, mallyhavetoEditorcreateaanassessmentt.Hereyoucaanalsoloadorrsave younorm theassesssmentifneeded.Thenwheentheassessm mentisready,youStartthe Figure1Thelogindialog,whereyyou selectserverand dlogin. process,byuploadingtheassessmentsetuptotheserver.Whentheassessmentis uploaded,theprogramimmediatelystartsMonitoringtheassessment. Figure3ThemenusysteminDoneITC,withthenetworkstat. Whenstudentshavesubmittedtheirresults,youcanEndtheassessment,start consideringtheresultsandselectquestionsthatyouwanttotakebacktotheclass. ThenInClass,yougetatransparentapplicationwhereyoucanpickresults,orsend thequestionbacktothestudents. Network status. Figure4Networkstatus indicator. Intheupperareaofthemainapplicationisavisualfeedbackisgivenonthe networkstatus.Ifyouarenotonline,yougetaredcrossovertheinternetsymbol, indicatingalostconnection. Thetablebelowexplainsthesymbolsinthenetworkstatusinterfaceandwhatthey represent. Symbol Symbol Computeronline Serveronlineandresponding Servicerespondingcorrectly Errormessage Youarenotonline Theserverisnotresponding. Servernotonlineorwrong address. Theserviceisnotresponding correctly ThisnumberistheHTTPstatusnumber fromthelastinteractionwiththeserver.Shouldbea200butnotlager than299. Table1Thesymbolsusedinthenetworkmonitoringinterface. Creating an assessment Whenyouwanttocreateanewassessment,gotoEditandchoseCreate. Figure5Themenusystemandwhereyoustartcreatinganewassessment. Thiswillbringupacreateassessmentwizardinfoursteps. Step one, metadata Thefirststepprovidesaninterfacewhereyouasateachercanfillinnmetadata abouttheassessment. Figure6Theemetadatastepinthewizard Hereyoucanfillintheassessmentname,acourseename,ashortdescriptionabout theassesssment.Thisprrovidesonlyasareminderffortheteacheerwhythiswaasdone. Thenyoucanfillinnam messagetothestudents,amessagethatwillappearonthe nterfacewhen ntheyloginto otheassessmeent. studentin Thesecon ndstepoftheassessmentissaninterfaceforcreatingthemainassesssment form. Noticce!Thenumberofquestion nsis setfo ortheassessm menthere.You u can’ttinthecurren ntversionadd questionslater.Th hisisamissingg featu urethatweareplanningtoadd later. Figure7Steptwowiththenu umberofquestio onsandthenumb berofalternativessoneachquestio on. Then numberofqueestionshasatthecurrentversionbeenlimitedto50andthe numb berofalternattiveshasbeen nlimitedto10 0.Youcanadd dordeletealtternatives laterwhenyou Afterrthat,insteptthenextinterfaceistheinterfacewhereyoucansetth hetimeand dateoftheassessm ment.Thisfeaatureisnotuseednow. Notice!Timingofwh henthe assessm mentstarts,an ndforhowlon ng theasseessmentshouldlastisnot usedincurrentversio on.Theplanissto beabletosetatimewindowforseelf mentsorsimilaartasks. assessm Figure8Settingdatean ndtimeoftheasssessment Thelaststepconsidersthegeneeralrulesofth heassessmentt.Thisiswhereeyouset thescoregivenforrselectingaco orrectorwron ngalternative.Youcanalsosetthe scoreegivenfornottrespondingttoaquestion. Figure9Thefourthstepofthewizardwhereyousettherules. Thedefaultscoreforcorrectchoiceis1butyoucanchangethisfrom0to3.You cangivethescoreforawronganswerfromͲ3to1.Nochoicegivesthescoreifthe studentisnotresponding.IfyouAllowbleeding,anegativescorefromone questioncanbetransferredtothetotal.Ifyoudonotallowbleeding,theminimal scorecanalwaysbezero.Thisisanoptionthatreallymattersifyouhavemorethan onecorrectalternative.Twoalternativeswrongmightgiveanegativescoreifyou allowbleeding. Edit assessment setup file Whenyouhavefinishedthefirstfourstepsoftheassessmentsetupwizard,youget theassessmentsetupdocumentdisplayed.Thiscontainsalistofquestionswhere youhavetoaddinformationaboutwhatalternativeiscorrectornot. Figure10Theinterfacewhereyoucaneditandsetthedetailsintheassessmentsetup. Whentheassessmentsetupdocumentisinmemory,youcanseethiswiththe documentsetupintheupperrightcorner.Byclickingontheicon,youcaneditthe documentagain Figure11Thedocumentinmemoryiconshowingthattheassessmentdocumentiscreatedandexcist. Thisinterfacehasabuttonwhereyoucanswitchbetweenthequestionsandthe metadataview. Figure13Themetadatadisplayedintheassessmentsetupdocument. Nowitstimetoadjusteachquestionandsetthecorrectalternatives Figure14Questiononewherealternativeahasbeenselectedascorrect. Figure12 Standardrules settings.Herethegeneral rulescanbesetforall questions,bleeding,correct wrongandnoselection scoreandamaximumand minimumcalculatedscore. Yousimplyclickonthealternative.InFigure14a)hasbeenselectedascorrect. Since“UsestandardRules”hasbeenset,thisgivesthestandardrulestothis question.Thestandardrulesyoucanadjustintherighthandpartoftheinterface. Ifyouneedtoaddorremoveonealternative,press toaddanalternativeand toremoveanalternative.Themaxandminimumscoreofthatquestionwill changeasyouselectcorrectalternatives. Youcanhoweveroverridethestandardrulesandremovethe“usestandardrules”. Thisallowsyoutheseethescoreandsetothervaluesforthescore. Figure15Questionsetupwith“usestandardrules”unselected. Youcanmanuallyenteranumberandifyouallowthequestiontobleedthescore canrangefromanegativescoretoapositivescore,asshowninFigure16 Figure e16Thesamequeestionssetupwithdifferentscoresssetforthealternatives. S Simulatio on ( The m monkey c cage) W Whentheassesssmentissetupandyouhavvetherulesreeady,youwillinfuture veersionsbeableetosimulatettheassessmen nt.Assumethatyougivetheassessment to oabunchofm monkeysandN Nmonkeyspreessatrandom,,whatscorew willtheyget? Th hesimulationttoolwillproviidesomeinsigghtintohoweeasyitistogettascore,and alssopossibleou utcomesofyousetup.Thisffeatureweareetestingandttriestomake reesultsavailableefortheusertointerpret.H Howeveritsdiisabledfromtthisversion. Sav ve and lo oad Onceeyouhavecreeatedanassessmentsetup,youcansavethistoafile.A Asavedfile youccanloadagain n. Figure e17Thecreate,lo oadandsavemenuunderEdit. When nyouloadafiile.Youareasskedifyouwanttodisplayttheassessmen ntsetup documentornot.IIfyourespond dwithyes,theedocumentisdisplayedand dyoucan heassessmentt.Ifyourespo ondno,theapplicationjump psdirectly continueeditionth ucanstarttheeassessment. tostaart,whereyou Letts start When ntheassessm mentissetupaandready,gotoStartandyyougetabigggreen butto on.Whenyoupressthegreenbutton,theeassessmentisuploadedto othe serveer. Figure18Th hebiggreenstarttbutton. Theappliccationnowim mmediatelystaartsmonitorin ngtheassessm ment.Noticehowyou assessmentnowgotan nassessmentccode. Figure19Th heapplicationnow wdisplayingtheaassessmentcodeencircledinthisimage. Thestudeentsnowcanllogintotheseessionatthefo ollowingaddress: http:///aftͲtest.hiist.no/srsͲͲassessment/pluginss/app/ Thestudeentsrespondw withawebbro owserusingacellphone(iPhone,iPod,iP Pad) worksattthemoment,o orwithaWeb bkitbrowser,llikeGoogleCh hromeorSarafi. Stude ent interfface on lo ogin Whentheestudentsfollowthelinkto othewebinterfacetheygettaloginwindo ow. Figure20Th hestudentinterfaaceonlogin. Whentheeyhavelogged din,awelcom mepagewillap ppear.Hereyo ouwillfindyo ou metadataasuchastheccoursenameaandthemessaagethatyouin nsertedinthe metadataaoftheassesssment. No otice!Atthem momentthesttudent intterfacehaspro oblemswithA Android phones.Weareworkingonth he pro oblem!!! Figure21Startpageofthestudentinterface. NowthestudentsjustpressStartandcanstartresponding.Thestudentsthenwill getaninterfacewithaquicknavigationbaratthetopshowingthequestionnumber andanareawithallthealternatives. Figure22Thestudentsinterfacewheretheyfillintheresponses.Ontheleftsideyouseethepage beforefillinginnanalternative.Totheright,youseehowthepageconfirmstheselection. Bypressingonthewhiteareaofthealternatives,theyselectanalternative.When analternativeisselected,thenumberinthenavigationmenuisfilled.Nowthe studentcanmovetothenextquestionbypressingthenextquestiononthemenu orsimplydragandslidethepagetotheleft.Aquestionwhereresponsehasbeen givenischangingcoloroftheframefromredtoblue. Atthebottomofthepageisasetofbuttonsthestudentscanuse.Thefunctionof eachsymbolisgiveninthetablebelow. Symbol Meaningofthesymbol. Goto“home”page Help Markthisquestion Deletetheresponsestothisquestion FilteroutthequestionsIhaveansweredandleaveonlytheunanswered ones. Movetonext,previousquestionwithaflagshowingthenumberof questionsstillleftunanswered. Whenthestudentsmarkaquestion,theborderaroundthealternativesturns yellow,andthequestionistaggedinthetopnavigationmenu.Theteachercannow seethatthisquestionhasbeenmarked. Figure23Anexampleofastudentpagewherequestion3,5and7hasbeenmarkedbythestudent. Monitoring an assessment Monitoringoftheactivityisdonefortworeasons.Monitoringoftheactivitycanbe donewithtwomainviews,eitherasastudentorientedlistorasaquestion orientedlist.Thedefaultviewisthestudentorientedlistwheretheteachercansee thestudentsappearonthelistastheylogin,seeresponsesappearingandgeta pictureofstudentsastheysubmittheirassessment. Youcanseethatmonitoringisactivebylookingintothenetworkstatusareaand lookforagreenledblinkingontheservicestatus,asshowninFigure24. Figure24Whenthemonitoringisactive, youwillgetablinkinggreenleddisplayed ontheserviceicon.Eachtimethisshows agreendot,anupdateofcurrentstatusis requested. Thettreebuttonso ontopcontroltheviewofth heapplication n.Showswitch hbetween neutrraldisplayofrresponsesand ddetailsabouttcorrectorwrong.Showm marks displaaywhatquesttionshasbeen nmarked,and dtheshowressultssummaryydisplays theq questionorientedlist. Figure e25Thestudento orientedlistwherreeverystudenth hassubmittedtheirresponseexceepttheguest userattthebeginningo ofthelist. Notice!SStudentshasggivenus feedbackkonthismonittoring interface,,wheretheyaaskarelevant question;;Whyshouldtheteacher seewhom markedtheq question?This wemighttremovesuch hthatmarkingg ofquestio onsonlyappeearinthe questionorientedlistinfuture versions. Studeentsthathaveesubmittedth heirresponseappearwithaaninvertedname,black backggroundwithw whitecharacteers.Studentssstillworkingap ppearwithblu ue charaactersonwhittebackground d.Thesymbolssusedinthem monitoringintterfaceand them meaningofeacchsymbolisggiveninTable2below. Symb bol Meaningg Norespo onsegiventoquestion (Botthneutraland ddetailmode) Respons segiven (Neut tralmode) Responssegiven,questtionmarkedb bystudent (Neeutralmode) Correct responsegive en Wrongrresponsegiven n Correct responsegive en,questionm markedbystud dent Table2Symbolsusedin nthestudentorieentedmonitorvieew. Theq questionorien ntedviewdisp playsthequesttionsandhow wthestudentssare perfo ormingoneacchquestion.Yo ouswitchtoth hequestionorientedlistussingthe Show wResultsSum mmarybutton. Notice!!Thequestion norientedlist interfacceweareplan nningtochangge. Theplaanistohaveatreestatebar, showingpercentagecorrect, ndpercentagee percenttagewrongan unansw weredinoneb bar.Themarkss willapp pearinaseparatebar. Figure e26Thequestionorientedlist,witthnumberofcorrrectresponses,peercentagegraph,numberof wronggresponses,perceentagewrongbarr,numberofmarks,andthecardin nalityofthequesstion. YoucanswitchbacktothestudentorientedlistbypressingtheShowmonitoring matrixbutton. Whenyouwanttoendmonitoringofanassessment,youhavetogotothestepin themainmenu,EndandpresstheEndMonitoring.Thiswillbringupasmalldialog tellingyouthatmonitoringoftheassessmenthasended.Youcanstartthe monitoringagainbygoingtoLogin,findtheassessmentandpressthemonitoring button.Thiswillrestartmonitoringoftheassessment. Analyzing the results Whenyourstudentshaverespondedandsubmitted,youcanendthemonitoringby movingtoEnd. Thefirstbuttonstopsthemonitoring.Whenyoupressthis,monitoringisshutoff.If youpressGetResults,thelatestresultsareobtainedfromtheserver.Nowit’stime todoaquickanalysisoftheresponses. Figure27TheEndinterfacewiththeresults. Intheendinterfaceyoucangetanoverviewoftheresultsforeachquestion.You getabarshowingthepercentagecorrectanswers,percentagewronganswers,the numberofmarks,andaspreadfactor. Thespreadfactorisanindexrangingfrom0%to100%.Thisisafactorthatgiveyou ameasureofhowthespreadoftheresponsesare.Ifallhavegivenonealternative, youget0%iftheresponsesareequallydistributedoverallalternativesyougeta completespreadof100%. Youcanpresstheexpandbuttontoseemoredetailsofwhatresponseshasactually beengiven.Hereyouwillgetahistogramshowingthedistributionofalternatives chosen,andthetableshowingcountsofeachalternative.Thecorrectalternatives aremarkedinboththetableandthehistogram.YoucanpresstheContractbutton toremovetheadditionaldata. Figure28Thetablerowwhentheexpandbuttonhasbeenpressed. Whenyoufindquestionsshowssomehowthatthestudentshaveproblemswiththe question,youcanselectit.YouselectbypressingtheSelectbutton.Thispullsthe questionuptothebinofselectedquestions.Thesequestionsyoucanselectto bringintoclass.Hereyoucanselectonequestionorallifyouwantto. Figure29Thebinofselectedquestionsappearingwhenyouselectthequestion. Whenyouhaveselectedthosequestionsthatyoucanpossibletosomethingwith andcanpredictsomeactivityinclasswiththequestions,youarereadytogointo theclasswiththeresultsandstartthefunpart.Nowletthestudentslearnfromthe assessmentandstartworkingInClass. Working In Class WhenyoumovetoInClasstheapplicationturnstransparent.Thisisdonesoyouas ateachercanpresentthequestionsasyouworkwiththequestions. Figure30TheDoneITCapplicationontopofasimpleassessment. Nowyoucanfocusonthequestions,andhelpthestudentstounderstandthe problem. Figure32TheInClassmodewithquestion4selectedandtheactivitymenuselected. Nowifyoupressonselectedquestionnumberfour,yougetaquickmenuupwhere youcanchosethefollowing: x x x Presentthepercentagecorrect/wronganswers. Presentthehistogramofwhattheyvoted. Sendthequestionouttothedevicessothattheycanvoteagain. Figure33Theinteractivehistogramshowingwhatthestudentshaverespondedtothequestion. Thehistogramdisplayedisinteractive.Thatmeansthatyoucanselectan alternativeanditwillshifttogreencolor,soyouasateachercanhighlightone response.Ifnoonehasselectedthatalternativeyoucanstilldothis. Ifyouwanttoremovethegreencolor,clickagainanditwillberemoved. Figure31Atypicalpercentagecorrectwrong visualization. Figure34Histogramwithonealternativehighlighted. IfyouclickontheSRSbutton ,youwillsendthestudentsouttothesecond chaseloop.Thealternativesonthatselectedquestionwillappearonthevoting deviceandthestudentscansubmitagain.Asateacheryouwillnowgetanew dialogshowingthequestionnumber,numberofresponsesastheyappearandthe timespent.Whenyoufeelthatenoughtimehasbeengivenyoucanstop,andthe studentinterfacewillpresentapleasewaitinterface. Figure36Shecontrolinterfaceforthesecondchanceappearingwhenthestudentscandeliveranew response. NowwhentheSecondchanceisstoppedthedataappeartogetherwiththe selectedalternatives. Figure37Theselectedquestionswithtworunsofquestion4usingasecondchanceloop. Figure35Theactivitymenu focusingonquestionfourbutno lookingatthesecondchance(SRS) data. TheSRSbuttons( )behaveliketheselectedquestionbuttons.Whenyoupress thebuttonyougettheactivitymenuupagainandcanshowresultsorenteranew secondchanceloop. Results IntheAdm mininterfaceyoucannowlookattheressults.Hereyougetalistofall studentsaandwhattheyyhaverespon ndedandtheffinalscoreaccordingtotherules thatyouh haveset.Ifno odataappearintheAdmininterface,gotoEndandprressGet Resultsbu utton.Youwilllgetamessaggethatthelattestdatahasb beenloaded. Notice!Infuturreversionsthiisloading offalltheresultsforthatasseessment sh houldhappenautomaticallyywhen yo ouenterAdmin.Howeverw weneed to obeabletohaandleseveral asssessmentssim multaneouslyand heencethisinterrfacewilllookkdifferent in nfutureversio ons. Figure38Do oneITCconfirminggthatthelatestd datahasbeenloaaded. N Notice!Thispaartofthesoftw wareisat themomentth heweakestan ndleast d developedparrt.Yougetonlyythe aassessmentressultsforthe aassessmentthatisactiveand selected.Intheefutureyouw willbe aabletolookatbothassessm ment results,differeentsectionsifyouare u usingmorethaanonedefaulttsection aandSRSdata. TThisdatawillaalsobeableto oexport in ntotheExcelsspreadsheet. R Resultsfromth heSRSpart,issnot eexportedinthiisversion. Figure39Th hefinallistwithreesultsforthestud dents. IffyoupresstheeExporttoXLLSbutton,youwillnowbeaableto eexporttheresu ultsastheyap ppearinthelisstshownabovvein Figure39.Thisgivesyo ouastudentorientedlistwithwhattheyvvoted,whatscore theygotaandthecalculatedtotalscore.