What'd you say again? Recurrence quantification analysis as a method for analyzing the dynamics of discourse in a reading strategy tutor

Laura K. Allen, Aaron Likens, Cecile Perret, Danielle McNamara

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

In this study, we investigated the degree to which the cognitive processes in which students engage during reading comprehension could be examined through dynamical analyses of their natural language responses to texts. High school students (n = 142) generated typed self-explanations while reading a science text. They then completed a comprehension test that measured their comprehension at both surface and deep levels. The recurrent patterns of the words in students' self-explanations were first visualized in recurrence plots. These visualizations allowed us to qualitatively analyze the different self-explanation processes of skilled and less skilled readers. These recurrence plots then allowed us to calculate recurrence indices, which represented the properties of these temporal word patterns. Results of correlation and regression analyses revealed that these recurrence indices were significantly related to the students' comprehension scores at both surface- and deep levels. Additionally, when combined with summative metrics of word use, these indices were able to account for 32% of the variance in students' overall text comprehension scores. Overall, our results suggest that recurrence quantification analysis can be utilized to guide both qualitative and quantitative assessments of students' comprehension.

Original languageEnglish (US)
Title of host publicationLAK 2017 Conference Proceedings - 7th International Learning Analytics and Knowledge Conference: Understanding, Informing and Improving Learning with Data
PublisherAssociation for Computing Machinery
Pages373-382
Number of pages10
VolumePart F126742
ISBN (Electronic)9781450348706
DOIs
StatePublished - Mar 13 2017
Event7th International Conference on Learning Analytics and Knowledge, LAK 2017 - Vancouver, Canada
Duration: Mar 13 2017Mar 17 2017

Other

Other7th International Conference on Learning Analytics and Knowledge, LAK 2017
CountryCanada
CityVancouver
Period3/13/173/17/17

Fingerprint

Students
Visualization

Keywords

  • Corpus linguistics
  • Dynamics
  • Intelligent tutoring systems
  • Natural language processing
  • Reading
  • Stealth assessment

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Cite this

Allen, L. K., Likens, A., Perret, C., & McNamara, D. (2017). What'd you say again? Recurrence quantification analysis as a method for analyzing the dynamics of discourse in a reading strategy tutor. In LAK 2017 Conference Proceedings - 7th International Learning Analytics and Knowledge Conference: Understanding, Informing and Improving Learning with Data (Vol. Part F126742, pp. 373-382). Association for Computing Machinery. https://doi.org/10.1145/3027385.3027445

What'd you say again? Recurrence quantification analysis as a method for analyzing the dynamics of discourse in a reading strategy tutor. / Allen, Laura K.; Likens, Aaron; Perret, Cecile; McNamara, Danielle.

LAK 2017 Conference Proceedings - 7th International Learning Analytics and Knowledge Conference: Understanding, Informing and Improving Learning with Data. Vol. Part F126742 Association for Computing Machinery, 2017. p. 373-382.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Allen, LK, Likens, A, Perret, C & McNamara, D 2017, What'd you say again? Recurrence quantification analysis as a method for analyzing the dynamics of discourse in a reading strategy tutor. in LAK 2017 Conference Proceedings - 7th International Learning Analytics and Knowledge Conference: Understanding, Informing and Improving Learning with Data. vol. Part F126742, Association for Computing Machinery, pp. 373-382, 7th International Conference on Learning Analytics and Knowledge, LAK 2017, Vancouver, Canada, 3/13/17. https://doi.org/10.1145/3027385.3027445
Allen LK, Likens A, Perret C, McNamara D. What'd you say again? Recurrence quantification analysis as a method for analyzing the dynamics of discourse in a reading strategy tutor. In LAK 2017 Conference Proceedings - 7th International Learning Analytics and Knowledge Conference: Understanding, Informing and Improving Learning with Data. Vol. Part F126742. Association for Computing Machinery. 2017. p. 373-382 https://doi.org/10.1145/3027385.3027445
Allen, Laura K. ; Likens, Aaron ; Perret, Cecile ; McNamara, Danielle. / What'd you say again? Recurrence quantification analysis as a method for analyzing the dynamics of discourse in a reading strategy tutor. LAK 2017 Conference Proceedings - 7th International Learning Analytics and Knowledge Conference: Understanding, Informing and Improving Learning with Data. Vol. Part F126742 Association for Computing Machinery, 2017. pp. 373-382
@inproceedings{203e76fef60e490d9890bdc611da47ea,
title = "What'd you say again? Recurrence quantification analysis as a method for analyzing the dynamics of discourse in a reading strategy tutor",
abstract = "In this study, we investigated the degree to which the cognitive processes in which students engage during reading comprehension could be examined through dynamical analyses of their natural language responses to texts. High school students (n = 142) generated typed self-explanations while reading a science text. They then completed a comprehension test that measured their comprehension at both surface and deep levels. The recurrent patterns of the words in students' self-explanations were first visualized in recurrence plots. These visualizations allowed us to qualitatively analyze the different self-explanation processes of skilled and less skilled readers. These recurrence plots then allowed us to calculate recurrence indices, which represented the properties of these temporal word patterns. Results of correlation and regression analyses revealed that these recurrence indices were significantly related to the students' comprehension scores at both surface- and deep levels. Additionally, when combined with summative metrics of word use, these indices were able to account for 32{\%} of the variance in students' overall text comprehension scores. Overall, our results suggest that recurrence quantification analysis can be utilized to guide both qualitative and quantitative assessments of students' comprehension.",
keywords = "Corpus linguistics, Dynamics, Intelligent tutoring systems, Natural language processing, Reading, Stealth assessment",
author = "Allen, {Laura K.} and Aaron Likens and Cecile Perret and Danielle McNamara",
year = "2017",
month = "3",
day = "13",
doi = "10.1145/3027385.3027445",
language = "English (US)",
volume = "Part F126742",
pages = "373--382",
booktitle = "LAK 2017 Conference Proceedings - 7th International Learning Analytics and Knowledge Conference: Understanding, Informing and Improving Learning with Data",
publisher = "Association for Computing Machinery",

}

TY - GEN

T1 - What'd you say again? Recurrence quantification analysis as a method for analyzing the dynamics of discourse in a reading strategy tutor

AU - Allen, Laura K.

AU - Likens, Aaron

AU - Perret, Cecile

AU - McNamara, Danielle

PY - 2017/3/13

Y1 - 2017/3/13

N2 - In this study, we investigated the degree to which the cognitive processes in which students engage during reading comprehension could be examined through dynamical analyses of their natural language responses to texts. High school students (n = 142) generated typed self-explanations while reading a science text. They then completed a comprehension test that measured their comprehension at both surface and deep levels. The recurrent patterns of the words in students' self-explanations were first visualized in recurrence plots. These visualizations allowed us to qualitatively analyze the different self-explanation processes of skilled and less skilled readers. These recurrence plots then allowed us to calculate recurrence indices, which represented the properties of these temporal word patterns. Results of correlation and regression analyses revealed that these recurrence indices were significantly related to the students' comprehension scores at both surface- and deep levels. Additionally, when combined with summative metrics of word use, these indices were able to account for 32% of the variance in students' overall text comprehension scores. Overall, our results suggest that recurrence quantification analysis can be utilized to guide both qualitative and quantitative assessments of students' comprehension.

AB - In this study, we investigated the degree to which the cognitive processes in which students engage during reading comprehension could be examined through dynamical analyses of their natural language responses to texts. High school students (n = 142) generated typed self-explanations while reading a science text. They then completed a comprehension test that measured their comprehension at both surface and deep levels. The recurrent patterns of the words in students' self-explanations were first visualized in recurrence plots. These visualizations allowed us to qualitatively analyze the different self-explanation processes of skilled and less skilled readers. These recurrence plots then allowed us to calculate recurrence indices, which represented the properties of these temporal word patterns. Results of correlation and regression analyses revealed that these recurrence indices were significantly related to the students' comprehension scores at both surface- and deep levels. Additionally, when combined with summative metrics of word use, these indices were able to account for 32% of the variance in students' overall text comprehension scores. Overall, our results suggest that recurrence quantification analysis can be utilized to guide both qualitative and quantitative assessments of students' comprehension.

KW - Corpus linguistics

KW - Dynamics

KW - Intelligent tutoring systems

KW - Natural language processing

KW - Reading

KW - Stealth assessment

UR - http://www.scopus.com/inward/record.url?scp=85016509055&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85016509055&partnerID=8YFLogxK

U2 - 10.1145/3027385.3027445

DO - 10.1145/3027385.3027445

M3 - Conference contribution

VL - Part F126742

SP - 373

EP - 382

BT - LAK 2017 Conference Proceedings - 7th International Learning Analytics and Knowledge Conference: Understanding, Informing and Improving Learning with Data

PB - Association for Computing Machinery

ER -