Automatic natural language processing and the detection of reading skills and reading comprehension

Chutima Boonthum-Denecke, Philip M. McCarthy, Travis A. Lamkin, G. Tanner Jackson, Joseph P. Magliano, Danielle McNamara

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

The primary goal of this study is to assess two approaches for detecting comprehension processes in R-SAT (Reading Strategy Assessment Tool). One approach is based on Latent Semantic Analysis (LSA) while the other is a combination of literal word matching and soundex. A secondary goal is to assess the potential for detecting specific reading comprehension strategies, either in isolation or combination. Participants typed "think-aloud" protocols while reading texts presented on computers. Human judges rated these protocols for the presence of the various reading comprehension strategies. LSA, word, and combined algorithms were compared and the results showed that a combination of both approaches yielded the best results. However, performance of the combined algorithm varied in terms of the type of processes and the grain size of the human coding system. Lastly, the use of reading strategies (either in isolation or combination) is positivity related to students' Gates-MacGinitie reading comprehension scores, which illustrates the merit of this approach for assessing comprehension skill.

Original languageEnglish (US)
Title of host publicationProceedings of the 24th International Florida Artificial Intelligence Research Society, FLAIRS - 24
Pages234-239
Number of pages6
StatePublished - 2011
Externally publishedYes
Event24th International Florida Artificial Intelligence Research Society, FLAIRS - 24 - Palm Beach, FL, United States
Duration: May 18 2011May 20 2011

Other

Other24th International Florida Artificial Intelligence Research Society, FLAIRS - 24
CountryUnited States
CityPalm Beach, FL
Period5/18/115/20/11

Fingerprint

Semantics
Processing
Students

ASJC Scopus subject areas

  • Artificial Intelligence

Cite this

Boonthum-Denecke, C., McCarthy, P. M., Lamkin, T. A., Jackson, G. T., Magliano, J. P., & McNamara, D. (2011). Automatic natural language processing and the detection of reading skills and reading comprehension. In Proceedings of the 24th International Florida Artificial Intelligence Research Society, FLAIRS - 24 (pp. 234-239)

Automatic natural language processing and the detection of reading skills and reading comprehension. / Boonthum-Denecke, Chutima; McCarthy, Philip M.; Lamkin, Travis A.; Jackson, G. Tanner; Magliano, Joseph P.; McNamara, Danielle.

Proceedings of the 24th International Florida Artificial Intelligence Research Society, FLAIRS - 24. 2011. p. 234-239.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Boonthum-Denecke, C, McCarthy, PM, Lamkin, TA, Jackson, GT, Magliano, JP & McNamara, D 2011, Automatic natural language processing and the detection of reading skills and reading comprehension. in Proceedings of the 24th International Florida Artificial Intelligence Research Society, FLAIRS - 24. pp. 234-239, 24th International Florida Artificial Intelligence Research Society, FLAIRS - 24, Palm Beach, FL, United States, 5/18/11.
Boonthum-Denecke C, McCarthy PM, Lamkin TA, Jackson GT, Magliano JP, McNamara D. Automatic natural language processing and the detection of reading skills and reading comprehension. In Proceedings of the 24th International Florida Artificial Intelligence Research Society, FLAIRS - 24. 2011. p. 234-239
Boonthum-Denecke, Chutima ; McCarthy, Philip M. ; Lamkin, Travis A. ; Jackson, G. Tanner ; Magliano, Joseph P. ; McNamara, Danielle. / Automatic natural language processing and the detection of reading skills and reading comprehension. Proceedings of the 24th International Florida Artificial Intelligence Research Society, FLAIRS - 24. 2011. pp. 234-239
@inproceedings{9f098e700f7e4666a3468672e2fec48d,
title = "Automatic natural language processing and the detection of reading skills and reading comprehension",
abstract = "The primary goal of this study is to assess two approaches for detecting comprehension processes in R-SAT (Reading Strategy Assessment Tool). One approach is based on Latent Semantic Analysis (LSA) while the other is a combination of literal word matching and soundex. A secondary goal is to assess the potential for detecting specific reading comprehension strategies, either in isolation or combination. Participants typed {"}think-aloud{"} protocols while reading texts presented on computers. Human judges rated these protocols for the presence of the various reading comprehension strategies. LSA, word, and combined algorithms were compared and the results showed that a combination of both approaches yielded the best results. However, performance of the combined algorithm varied in terms of the type of processes and the grain size of the human coding system. Lastly, the use of reading strategies (either in isolation or combination) is positivity related to students' Gates-MacGinitie reading comprehension scores, which illustrates the merit of this approach for assessing comprehension skill.",
author = "Chutima Boonthum-Denecke and McCarthy, {Philip M.} and Lamkin, {Travis A.} and Jackson, {G. Tanner} and Magliano, {Joseph P.} and Danielle McNamara",
year = "2011",
language = "English (US)",
isbn = "9781577355014",
pages = "234--239",
booktitle = "Proceedings of the 24th International Florida Artificial Intelligence Research Society, FLAIRS - 24",

}

TY - GEN

T1 - Automatic natural language processing and the detection of reading skills and reading comprehension

AU - Boonthum-Denecke, Chutima

AU - McCarthy, Philip M.

AU - Lamkin, Travis A.

AU - Jackson, G. Tanner

AU - Magliano, Joseph P.

AU - McNamara, Danielle

PY - 2011

Y1 - 2011

N2 - The primary goal of this study is to assess two approaches for detecting comprehension processes in R-SAT (Reading Strategy Assessment Tool). One approach is based on Latent Semantic Analysis (LSA) while the other is a combination of literal word matching and soundex. A secondary goal is to assess the potential for detecting specific reading comprehension strategies, either in isolation or combination. Participants typed "think-aloud" protocols while reading texts presented on computers. Human judges rated these protocols for the presence of the various reading comprehension strategies. LSA, word, and combined algorithms were compared and the results showed that a combination of both approaches yielded the best results. However, performance of the combined algorithm varied in terms of the type of processes and the grain size of the human coding system. Lastly, the use of reading strategies (either in isolation or combination) is positivity related to students' Gates-MacGinitie reading comprehension scores, which illustrates the merit of this approach for assessing comprehension skill.

AB - The primary goal of this study is to assess two approaches for detecting comprehension processes in R-SAT (Reading Strategy Assessment Tool). One approach is based on Latent Semantic Analysis (LSA) while the other is a combination of literal word matching and soundex. A secondary goal is to assess the potential for detecting specific reading comprehension strategies, either in isolation or combination. Participants typed "think-aloud" protocols while reading texts presented on computers. Human judges rated these protocols for the presence of the various reading comprehension strategies. LSA, word, and combined algorithms were compared and the results showed that a combination of both approaches yielded the best results. However, performance of the combined algorithm varied in terms of the type of processes and the grain size of the human coding system. Lastly, the use of reading strategies (either in isolation or combination) is positivity related to students' Gates-MacGinitie reading comprehension scores, which illustrates the merit of this approach for assessing comprehension skill.

UR - http://www.scopus.com/inward/record.url?scp=80052397848&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80052397848&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:80052397848

SN - 9781577355014

SP - 234

EP - 239

BT - Proceedings of the 24th International Florida Artificial Intelligence Research Society, FLAIRS - 24

ER -