You've got style: Detecting writing flexibility across time

Erica L. Snow, Cecile A. Perret, Laura K. Allen, Matthew E. Jacovina, Danielle McNamara

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

Writing researchers have suggested that students who are perceived as strong writers (i.e., those who generate texts that are rated as high quality) demonstrate flexibility in their writing style. While anecdotally this has been a commonly held belief among researchers, scientists, and educators, there is little empirical research to support this claim. This study investigates this hypothesis by examining how students vary in their use of linguistic features across 16 prompt-based essays. Forty-five high school students wrote 16 essays across 8 sessions within an Automated Writing Evaluation (AWE) system. Natural language processing (NLP) techniques and Entropy analyses were used to calculate how rigid or flexible students were in their use of narrative linguistic features over time and how this trait related to individual differences in literacy ability and essay quality. Additional analyses indicated that NLP and Entropy reliably detected narrative flexibility (or rigidity) after session 2 and was related to students' prior literacy skills. These exploratory methodologies are important for researchers and educators, as they indicate that writing flexibility is indeed a trait of strong writers and can be detected rather quickly using the combination of textual features and dynamic analyses.

Original languageEnglish (US)
Title of host publicationACM International Conference Proceeding Series
PublisherAssociation for Computing Machinery
Pages194-202
Number of pages9
Volume16-20-March-2015
ISBN (Print)9781450334174
DOIs
StatePublished - Mar 16 2015
Event5th International Conference on Learning Analytics and Knowledge, LAK 2015 - Poughkeepsie, United States
Duration: Mar 16 2015Mar 20 2015

Other

Other5th International Conference on Learning Analytics and Knowledge, LAK 2015
CountryUnited States
CityPoughkeepsie
Period3/16/153/20/15

Fingerprint

Students
Linguistics
Entropy
Processing
Rigidity

Keywords

  • Entropy
  • Flexibility
  • Individual Differences
  • Narrativity
  • Writing Quality

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Cite this

Snow, E. L., Perret, C. A., Allen, L. K., Jacovina, M. E., & McNamara, D. (2015). You've got style: Detecting writing flexibility across time. In ACM International Conference Proceeding Series (Vol. 16-20-March-2015, pp. 194-202). Association for Computing Machinery. https://doi.org/10.1145/2723576.2723592

You've got style : Detecting writing flexibility across time. / Snow, Erica L.; Perret, Cecile A.; Allen, Laura K.; Jacovina, Matthew E.; McNamara, Danielle.

ACM International Conference Proceeding Series. Vol. 16-20-March-2015 Association for Computing Machinery, 2015. p. 194-202.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Snow, EL, Perret, CA, Allen, LK, Jacovina, ME & McNamara, D 2015, You've got style: Detecting writing flexibility across time. in ACM International Conference Proceeding Series. vol. 16-20-March-2015, Association for Computing Machinery, pp. 194-202, 5th International Conference on Learning Analytics and Knowledge, LAK 2015, Poughkeepsie, United States, 3/16/15. https://doi.org/10.1145/2723576.2723592
Snow EL, Perret CA, Allen LK, Jacovina ME, McNamara D. You've got style: Detecting writing flexibility across time. In ACM International Conference Proceeding Series. Vol. 16-20-March-2015. Association for Computing Machinery. 2015. p. 194-202 https://doi.org/10.1145/2723576.2723592
Snow, Erica L. ; Perret, Cecile A. ; Allen, Laura K. ; Jacovina, Matthew E. ; McNamara, Danielle. / You've got style : Detecting writing flexibility across time. ACM International Conference Proceeding Series. Vol. 16-20-March-2015 Association for Computing Machinery, 2015. pp. 194-202
@inproceedings{ef1f61bc776a488c9505bd39c34c8947,
title = "You've got style: Detecting writing flexibility across time",
abstract = "Writing researchers have suggested that students who are perceived as strong writers (i.e., those who generate texts that are rated as high quality) demonstrate flexibility in their writing style. While anecdotally this has been a commonly held belief among researchers, scientists, and educators, there is little empirical research to support this claim. This study investigates this hypothesis by examining how students vary in their use of linguistic features across 16 prompt-based essays. Forty-five high school students wrote 16 essays across 8 sessions within an Automated Writing Evaluation (AWE) system. Natural language processing (NLP) techniques and Entropy analyses were used to calculate how rigid or flexible students were in their use of narrative linguistic features over time and how this trait related to individual differences in literacy ability and essay quality. Additional analyses indicated that NLP and Entropy reliably detected narrative flexibility (or rigidity) after session 2 and was related to students' prior literacy skills. These exploratory methodologies are important for researchers and educators, as they indicate that writing flexibility is indeed a trait of strong writers and can be detected rather quickly using the combination of textual features and dynamic analyses.",
keywords = "Entropy, Flexibility, Individual Differences, Narrativity, Writing Quality",
author = "Snow, {Erica L.} and Perret, {Cecile A.} and Allen, {Laura K.} and Jacovina, {Matthew E.} and Danielle McNamara",
year = "2015",
month = "3",
day = "16",
doi = "10.1145/2723576.2723592",
language = "English (US)",
isbn = "9781450334174",
volume = "16-20-March-2015",
pages = "194--202",
booktitle = "ACM International Conference Proceeding Series",
publisher = "Association for Computing Machinery",

}

TY - GEN

T1 - You've got style

T2 - Detecting writing flexibility across time

AU - Snow, Erica L.

AU - Perret, Cecile A.

AU - Allen, Laura K.

AU - Jacovina, Matthew E.

AU - McNamara, Danielle

PY - 2015/3/16

Y1 - 2015/3/16

N2 - Writing researchers have suggested that students who are perceived as strong writers (i.e., those who generate texts that are rated as high quality) demonstrate flexibility in their writing style. While anecdotally this has been a commonly held belief among researchers, scientists, and educators, there is little empirical research to support this claim. This study investigates this hypothesis by examining how students vary in their use of linguistic features across 16 prompt-based essays. Forty-five high school students wrote 16 essays across 8 sessions within an Automated Writing Evaluation (AWE) system. Natural language processing (NLP) techniques and Entropy analyses were used to calculate how rigid or flexible students were in their use of narrative linguistic features over time and how this trait related to individual differences in literacy ability and essay quality. Additional analyses indicated that NLP and Entropy reliably detected narrative flexibility (or rigidity) after session 2 and was related to students' prior literacy skills. These exploratory methodologies are important for researchers and educators, as they indicate that writing flexibility is indeed a trait of strong writers and can be detected rather quickly using the combination of textual features and dynamic analyses.

AB - Writing researchers have suggested that students who are perceived as strong writers (i.e., those who generate texts that are rated as high quality) demonstrate flexibility in their writing style. While anecdotally this has been a commonly held belief among researchers, scientists, and educators, there is little empirical research to support this claim. This study investigates this hypothesis by examining how students vary in their use of linguistic features across 16 prompt-based essays. Forty-five high school students wrote 16 essays across 8 sessions within an Automated Writing Evaluation (AWE) system. Natural language processing (NLP) techniques and Entropy analyses were used to calculate how rigid or flexible students were in their use of narrative linguistic features over time and how this trait related to individual differences in literacy ability and essay quality. Additional analyses indicated that NLP and Entropy reliably detected narrative flexibility (or rigidity) after session 2 and was related to students' prior literacy skills. These exploratory methodologies are important for researchers and educators, as they indicate that writing flexibility is indeed a trait of strong writers and can be detected rather quickly using the combination of textual features and dynamic analyses.

KW - Entropy

KW - Flexibility

KW - Individual Differences

KW - Narrativity

KW - Writing Quality

UR - http://www.scopus.com/inward/record.url?scp=84955594145&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84955594145&partnerID=8YFLogxK

U2 - 10.1145/2723576.2723592

DO - 10.1145/2723576.2723592

M3 - Conference contribution

AN - SCOPUS:84955594145

SN - 9781450334174

VL - 16-20-March-2015

SP - 194

EP - 202

BT - ACM International Conference Proceeding Series

PB - Association for Computing Machinery

ER -