TY - GEN
T1 - Internal usability testing of automated essay feedback in an intelligent writing tutor
AU - Roscoe, Rod D.
AU - Varner, Laura K.
AU - Cai, Zhiqiang
AU - Weston, Jennifer L.
AU - Crossley, Scott A.
AU - McNamara, Danielle S.
PY - 2011
Y1 - 2011
N2 - Research on automated essay scoring (AES) indicates that computer-generated essay ratings are comparable to human ratings. However, despite investigations into the accuracy and reliability of AES scores, less attention has been paid to the feedback delivered to the students. This paper presents a method developers can use to quickly evaluate the usability of an automated feedback system prior to testing with students. Using this method, researchers evaluated the feedback provided by the Writing-Pal, an intelligent tutor for writing strategies. Lessons learned and potential for future research are discussed.
AB - Research on automated essay scoring (AES) indicates that computer-generated essay ratings are comparable to human ratings. However, despite investigations into the accuracy and reliability of AES scores, less attention has been paid to the feedback delivered to the students. This paper presents a method developers can use to quickly evaluate the usability of an automated feedback system prior to testing with students. Using this method, researchers evaluated the feedback provided by the Writing-Pal, an intelligent tutor for writing strategies. Lessons learned and potential for future research are discussed.
UR - http://www.scopus.com/inward/record.url?scp=80052411264&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=80052411264&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:80052411264
SN - 9781577355014
T3 - Proceedings of the 24th International Florida Artificial Intelligence Research Society, FLAIRS - 24
SP - 543
EP - 548
BT - Proceedings of the 24th International Florida Artificial Intelligence Research Society, FLAIRS - 24
T2 - 24th International Florida Artificial Intelligence Research Society, FLAIRS - 24
Y2 - 18 May 2011 through 20 May 2011
ER -