TY - GEN
T1 - Assessing forward-, reverse-, and average-entailer indices on natural language input from the Intelligent Tutoring System, iSTART
AU - McCarthy, Philip M.
AU - Rus, Vasile
AU - Crossley, Scott A.
AU - Graesser, Arthur C.
AU - McNamara, Danielle S.
PY - 2008
Y1 - 2008
N2 - This study reports on an experiment that analyzes a variety of entailment evaluations provided by a lexico-syntactic tool, the Entailer. The environment for these analyses is from a corpus of self-explanations taken from the Intelligent Tutoring System, iSTART. The purpose of this study is to examine how evaluations of hand-coded entailment, paraphrase, and elaboration compare to various evaluations provided by the Entailer. The evaluations include standard entailment (forward) as well as the new indices of Reverse- and Average-Entailment. The study finds that the Entailer's indices match or surpass human evaluators in making textual evaluations. The findings have important implications for providing accurate and appropriate feedback to users of Intelligent Tutoring Systems.
AB - This study reports on an experiment that analyzes a variety of entailment evaluations provided by a lexico-syntactic tool, the Entailer. The environment for these analyses is from a corpus of self-explanations taken from the Intelligent Tutoring System, iSTART. The purpose of this study is to examine how evaluations of hand-coded entailment, paraphrase, and elaboration compare to various evaluations provided by the Entailer. The evaluations include standard entailment (forward) as well as the new indices of Reverse- and Average-Entailment. The study finds that the Entailer's indices match or surpass human evaluators in making textual evaluations. The findings have important implications for providing accurate and appropriate feedback to users of Intelligent Tutoring Systems.
UR - http://www.scopus.com/inward/record.url?scp=55849112976&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=55849112976&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:55849112976
SN - 9781577353652
T3 - Proceedings of the 21th International Florida Artificial Intelligence Research Society Conference, FLAIRS-21
SP - 165
EP - 170
BT - Proceedings of the 21th International Florida Artificial Intelligence Research Society Conference, FLAIRS-21
T2 - 21th International Florida Artificial Intelligence Research Society Conference, FLAIRS-21
Y2 - 15 May 2008 through 17 May 2008
ER -