Are you reading my mind? Modeling students' reading comprehension skills with natural language processing techniques

Laura K. Allen, Erica L. Snow, Danielle McNamara

Research output: Chapter in Book/Report/Conference proceedingConference contribution

16 Citations (Scopus)

Abstract

This study builds upon previous work aimed at developing a student model of reading comprehension ability within the intelligent tutoring system, iSTART. Currently, the system evaluates students' self-explanation performance using a local, sentence-level algorithm and does not adapt content based on reading ability. The current study leverages natural language processing tools to build models of students' comprehension ability from the linguistic properties of their self-explanations. Students (n = 126) interacted with iSTART across eight training sessions where they self-explained target sentences from complex science texts. Coh-Metrix was then used to calculate the linguistic properties of their aggregated self-explanations. The results of this study indicated that the linguistic indices were predictive of students' reading comprehension ability, over and above the current system algorithms. These results suggest that natural language processing techniques can inform stealth assessments and ultimately improve student models within intelligent tutoring systems.

Original languageEnglish (US)
Title of host publicationACM International Conference Proceeding Series
PublisherAssociation for Computing Machinery
Pages246-254
Number of pages9
Volume16-20-March-2015
ISBN (Print)9781450334174
DOIs
StatePublished - Mar 16 2015
Event5th International Conference on Learning Analytics and Knowledge, LAK 2015 - Poughkeepsie, United States
Duration: Mar 16 2015Mar 20 2015

Other

Other5th International Conference on Learning Analytics and Knowledge, LAK 2015
CountryUnited States
CityPoughkeepsie
Period3/16/153/20/15

Fingerprint

Students
Processing
Linguistics
Intelligent systems

Keywords

  • Corpus linguistics
  • Intelligent Tutoring Systems
  • NATURAL Language Processing
  • Reading comprehension
  • Stealth assessment

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Cite this

Allen, L. K., Snow, E. L., & McNamara, D. (2015). Are you reading my mind? Modeling students' reading comprehension skills with natural language processing techniques. In ACM International Conference Proceeding Series (Vol. 16-20-March-2015, pp. 246-254). Association for Computing Machinery. https://doi.org/10.1145/2723576.2723617

Are you reading my mind? Modeling students' reading comprehension skills with natural language processing techniques. / Allen, Laura K.; Snow, Erica L.; McNamara, Danielle.

ACM International Conference Proceeding Series. Vol. 16-20-March-2015 Association for Computing Machinery, 2015. p. 246-254.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Allen, LK, Snow, EL & McNamara, D 2015, Are you reading my mind? Modeling students' reading comprehension skills with natural language processing techniques. in ACM International Conference Proceeding Series. vol. 16-20-March-2015, Association for Computing Machinery, pp. 246-254, 5th International Conference on Learning Analytics and Knowledge, LAK 2015, Poughkeepsie, United States, 3/16/15. https://doi.org/10.1145/2723576.2723617
Allen LK, Snow EL, McNamara D. Are you reading my mind? Modeling students' reading comprehension skills with natural language processing techniques. In ACM International Conference Proceeding Series. Vol. 16-20-March-2015. Association for Computing Machinery. 2015. p. 246-254 https://doi.org/10.1145/2723576.2723617
Allen, Laura K. ; Snow, Erica L. ; McNamara, Danielle. / Are you reading my mind? Modeling students' reading comprehension skills with natural language processing techniques. ACM International Conference Proceeding Series. Vol. 16-20-March-2015 Association for Computing Machinery, 2015. pp. 246-254
@inproceedings{6196f8ff9b2a4a058055c0bc1bc790ab,
title = "Are you reading my mind? Modeling students' reading comprehension skills with natural language processing techniques",
abstract = "This study builds upon previous work aimed at developing a student model of reading comprehension ability within the intelligent tutoring system, iSTART. Currently, the system evaluates students' self-explanation performance using a local, sentence-level algorithm and does not adapt content based on reading ability. The current study leverages natural language processing tools to build models of students' comprehension ability from the linguistic properties of their self-explanations. Students (n = 126) interacted with iSTART across eight training sessions where they self-explained target sentences from complex science texts. Coh-Metrix was then used to calculate the linguistic properties of their aggregated self-explanations. The results of this study indicated that the linguistic indices were predictive of students' reading comprehension ability, over and above the current system algorithms. These results suggest that natural language processing techniques can inform stealth assessments and ultimately improve student models within intelligent tutoring systems.",
keywords = "Corpus linguistics, Intelligent Tutoring Systems, NATURAL Language Processing, Reading comprehension, Stealth assessment",
author = "Allen, {Laura K.} and Snow, {Erica L.} and Danielle McNamara",
year = "2015",
month = "3",
day = "16",
doi = "10.1145/2723576.2723617",
language = "English (US)",
isbn = "9781450334174",
volume = "16-20-March-2015",
pages = "246--254",
booktitle = "ACM International Conference Proceeding Series",
publisher = "Association for Computing Machinery",

}

TY - GEN

T1 - Are you reading my mind? Modeling students' reading comprehension skills with natural language processing techniques

AU - Allen, Laura K.

AU - Snow, Erica L.

AU - McNamara, Danielle

PY - 2015/3/16

Y1 - 2015/3/16

N2 - This study builds upon previous work aimed at developing a student model of reading comprehension ability within the intelligent tutoring system, iSTART. Currently, the system evaluates students' self-explanation performance using a local, sentence-level algorithm and does not adapt content based on reading ability. The current study leverages natural language processing tools to build models of students' comprehension ability from the linguistic properties of their self-explanations. Students (n = 126) interacted with iSTART across eight training sessions where they self-explained target sentences from complex science texts. Coh-Metrix was then used to calculate the linguistic properties of their aggregated self-explanations. The results of this study indicated that the linguistic indices were predictive of students' reading comprehension ability, over and above the current system algorithms. These results suggest that natural language processing techniques can inform stealth assessments and ultimately improve student models within intelligent tutoring systems.

AB - This study builds upon previous work aimed at developing a student model of reading comprehension ability within the intelligent tutoring system, iSTART. Currently, the system evaluates students' self-explanation performance using a local, sentence-level algorithm and does not adapt content based on reading ability. The current study leverages natural language processing tools to build models of students' comprehension ability from the linguistic properties of their self-explanations. Students (n = 126) interacted with iSTART across eight training sessions where they self-explained target sentences from complex science texts. Coh-Metrix was then used to calculate the linguistic properties of their aggregated self-explanations. The results of this study indicated that the linguistic indices were predictive of students' reading comprehension ability, over and above the current system algorithms. These results suggest that natural language processing techniques can inform stealth assessments and ultimately improve student models within intelligent tutoring systems.

KW - Corpus linguistics

KW - Intelligent Tutoring Systems

KW - NATURAL Language Processing

KW - Reading comprehension

KW - Stealth assessment

UR - http://www.scopus.com/inward/record.url?scp=84955586078&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84955586078&partnerID=8YFLogxK

U2 - 10.1145/2723576.2723617

DO - 10.1145/2723576.2723617

M3 - Conference contribution

AN - SCOPUS:84955586078

SN - 9781450334174

VL - 16-20-March-2015

SP - 246

EP - 254

BT - ACM International Conference Proceeding Series

PB - Association for Computing Machinery

ER -