Abstract

Self-explanations are commonly used to assess on-line reading comprehension processes. However, traditional methods of analysis ignore important temporal variations in these explanations. This study investigated how dynamical systems theory could be used to reveal linguistic patterns that are predictive of self-explanation quality. High school students (n = 232) generated self-explanations while they read a science text. Recurrence Plots were generated to show qualitative differences in students’ linguistic sequences that were later quantified by indices derived by Recurrence Quantification Analysis (RQA). To predict self-explanation quality, RQA indices, along with summative measures (i.e., number of words, mean word length, and type-token ration) and general reading ability, served as predictors in a series of regression models. Regression analyses indicated that recurrence in students’ self-explanations significantly predicted human rated self-explanation quality, even after controlling for summative measures of self-explanations, individual differences, and the text that was read (R2 = 0.68). These results demonstrate the utility of RQA in exposing and quantifying temporal structure in student’s self-explanations. Further, they imply that dynamical systems methodology can be used to uncover important processes that occur during comprehension.

Original languageEnglish (US)
Title of host publicationProceedings of the 8th International Conference on Learning Analytics and Knowledge
Subtitle of host publicationTowards User-Centred Learning Analytics, LAK 2018
PublisherAssociation for Computing Machinery
Pages111-120
Number of pages10
ISBN (Electronic)9781450364003
DOIs
StatePublished - Mar 7 2018
Event8th International Conference on Learning Analytics and Knowledge, LAK 2018 - Sydney, Australia
Duration: Mar 5 2018Mar 9 2018

Other

Other8th International Conference on Learning Analytics and Knowledge, LAK 2018
CountryAustralia
CitySydney
Period3/5/183/9/18

Fingerprint

Students
Linguistics
Dynamical systems
System theory

Keywords

  • Dynamical systems theory
  • Reading
  • Recurrence quantification analysis
  • Self-explanation
  • Text comprehension

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Cite this

Likens, A. D., McCarthy, K. S., Allen, L. K., & McNamara, D. (2018). Recurrence quantification analysis as a method for studying text comprehension dynamics. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge: Towards User-Centred Learning Analytics, LAK 2018 (pp. 111-120). Association for Computing Machinery. https://doi.org/10.1145/3170358.3170407

Recurrence quantification analysis as a method for studying text comprehension dynamics. / Likens, Aaron D.; McCarthy, Kathryn S.; Allen, Laura K.; McNamara, Danielle.

Proceedings of the 8th International Conference on Learning Analytics and Knowledge: Towards User-Centred Learning Analytics, LAK 2018. Association for Computing Machinery, 2018. p. 111-120.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Likens, AD, McCarthy, KS, Allen, LK & McNamara, D 2018, Recurrence quantification analysis as a method for studying text comprehension dynamics. in Proceedings of the 8th International Conference on Learning Analytics and Knowledge: Towards User-Centred Learning Analytics, LAK 2018. Association for Computing Machinery, pp. 111-120, 8th International Conference on Learning Analytics and Knowledge, LAK 2018, Sydney, Australia, 3/5/18. https://doi.org/10.1145/3170358.3170407
Likens AD, McCarthy KS, Allen LK, McNamara D. Recurrence quantification analysis as a method for studying text comprehension dynamics. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge: Towards User-Centred Learning Analytics, LAK 2018. Association for Computing Machinery. 2018. p. 111-120 https://doi.org/10.1145/3170358.3170407
Likens, Aaron D. ; McCarthy, Kathryn S. ; Allen, Laura K. ; McNamara, Danielle. / Recurrence quantification analysis as a method for studying text comprehension dynamics. Proceedings of the 8th International Conference on Learning Analytics and Knowledge: Towards User-Centred Learning Analytics, LAK 2018. Association for Computing Machinery, 2018. pp. 111-120
@inproceedings{28fade88531f4472a2184f47260668a0,
title = "Recurrence quantification analysis as a method for studying text comprehension dynamics",
abstract = "Self-explanations are commonly used to assess on-line reading comprehension processes. However, traditional methods of analysis ignore important temporal variations in these explanations. This study investigated how dynamical systems theory could be used to reveal linguistic patterns that are predictive of self-explanation quality. High school students (n = 232) generated self-explanations while they read a science text. Recurrence Plots were generated to show qualitative differences in students’ linguistic sequences that were later quantified by indices derived by Recurrence Quantification Analysis (RQA). To predict self-explanation quality, RQA indices, along with summative measures (i.e., number of words, mean word length, and type-token ration) and general reading ability, served as predictors in a series of regression models. Regression analyses indicated that recurrence in students’ self-explanations significantly predicted human rated self-explanation quality, even after controlling for summative measures of self-explanations, individual differences, and the text that was read (R2 = 0.68). These results demonstrate the utility of RQA in exposing and quantifying temporal structure in student’s self-explanations. Further, they imply that dynamical systems methodology can be used to uncover important processes that occur during comprehension.",
keywords = "Dynamical systems theory, Reading, Recurrence quantification analysis, Self-explanation, Text comprehension",
author = "Likens, {Aaron D.} and McCarthy, {Kathryn S.} and Allen, {Laura K.} and Danielle McNamara",
year = "2018",
month = "3",
day = "7",
doi = "10.1145/3170358.3170407",
language = "English (US)",
pages = "111--120",
booktitle = "Proceedings of the 8th International Conference on Learning Analytics and Knowledge",
publisher = "Association for Computing Machinery",

}

TY - GEN

T1 - Recurrence quantification analysis as a method for studying text comprehension dynamics

AU - Likens, Aaron D.

AU - McCarthy, Kathryn S.

AU - Allen, Laura K.

AU - McNamara, Danielle

PY - 2018/3/7

Y1 - 2018/3/7

N2 - Self-explanations are commonly used to assess on-line reading comprehension processes. However, traditional methods of analysis ignore important temporal variations in these explanations. This study investigated how dynamical systems theory could be used to reveal linguistic patterns that are predictive of self-explanation quality. High school students (n = 232) generated self-explanations while they read a science text. Recurrence Plots were generated to show qualitative differences in students’ linguistic sequences that were later quantified by indices derived by Recurrence Quantification Analysis (RQA). To predict self-explanation quality, RQA indices, along with summative measures (i.e., number of words, mean word length, and type-token ration) and general reading ability, served as predictors in a series of regression models. Regression analyses indicated that recurrence in students’ self-explanations significantly predicted human rated self-explanation quality, even after controlling for summative measures of self-explanations, individual differences, and the text that was read (R2 = 0.68). These results demonstrate the utility of RQA in exposing and quantifying temporal structure in student’s self-explanations. Further, they imply that dynamical systems methodology can be used to uncover important processes that occur during comprehension.

AB - Self-explanations are commonly used to assess on-line reading comprehension processes. However, traditional methods of analysis ignore important temporal variations in these explanations. This study investigated how dynamical systems theory could be used to reveal linguistic patterns that are predictive of self-explanation quality. High school students (n = 232) generated self-explanations while they read a science text. Recurrence Plots were generated to show qualitative differences in students’ linguistic sequences that were later quantified by indices derived by Recurrence Quantification Analysis (RQA). To predict self-explanation quality, RQA indices, along with summative measures (i.e., number of words, mean word length, and type-token ration) and general reading ability, served as predictors in a series of regression models. Regression analyses indicated that recurrence in students’ self-explanations significantly predicted human rated self-explanation quality, even after controlling for summative measures of self-explanations, individual differences, and the text that was read (R2 = 0.68). These results demonstrate the utility of RQA in exposing and quantifying temporal structure in student’s self-explanations. Further, they imply that dynamical systems methodology can be used to uncover important processes that occur during comprehension.

KW - Dynamical systems theory

KW - Reading

KW - Recurrence quantification analysis

KW - Self-explanation

KW - Text comprehension

UR - http://www.scopus.com/inward/record.url?scp=85045888835&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85045888835&partnerID=8YFLogxK

U2 - 10.1145/3170358.3170407

DO - 10.1145/3170358.3170407

M3 - Conference contribution

SP - 111

EP - 120

BT - Proceedings of the 8th International Conference on Learning Analytics and Knowledge

PB - Association for Computing Machinery

ER -