Checking it twice: Does adding spelling and grammar checkers improve essay quality in an automated writing tutor?

Kathryn S. McCarthy, Rod Roscoe, Aaron D. Likens, Danielle McNamara

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

This study investigated the effect of incorporating spelling and grammar checking tools within an automated writing tutoring system, Writing Pal. High school students (n = 119) wrote and revised six persuasive essays. After initial drafts, all students received formative feedback about writing strategies. Half of the participants were also given access to spelling and grammar checking tools during the writing and revision periods. Linear mixed effects models revealed that essay quality for students in both conditions improved from initial draft to revision in terms of all aspects except essay unity. The availability of spelling and grammar checking yielded added improvements from initial draft to revision for several aspects of essay quality (i.e., conclusion, organization, voice, grammar/mechanics, and word choice), but other aspects were unaffected (i.e., introduction, body, unity, and sentence structure). The availability of spelling and grammar checking tools had no effect on holistic essay scores. These results indicate that automated spelling and grammar feedback contribute to modest, incremental improvements in writing quality that may complement automated strategy feedback.

Original languageEnglish (US)
Title of host publicationArtificial Intelligence in Education - 20th International Conference, AIED 2019, Proceedings
EditorsSeiji Isotani, Peter Hastings, Amy Ogan, Bruce McLaren, Eva Millán, Rose Luckin
PublisherSpringer Verlag
Pages270-282
Number of pages13
ISBN (Print)9783030232030
DOIs
StatePublished - Jan 1 2019
Event20th International Conference on Artificial Intelligence in Education, AIED 2019 - Chicago, United States
Duration: Jun 25 2019Jun 29 2019

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11625 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference20th International Conference on Artificial Intelligence in Education, AIED 2019
CountryUnited States
CityChicago
Period6/25/196/29/19

Fingerprint

Grammar
Students
Feedback
Availability
Mechanics
Linear Mixed Effects Model
Complement
Strategy

Keywords

  • Automated writing evaluation
  • Feedback
  • Natural language processing
  • Spelling and grammar checking
  • Writing strategies

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

McCarthy, K. S., Roscoe, R., Likens, A. D., & McNamara, D. (2019). Checking it twice: Does adding spelling and grammar checkers improve essay quality in an automated writing tutor? In S. Isotani, P. Hastings, A. Ogan, B. McLaren, E. Millán, & R. Luckin (Eds.), Artificial Intelligence in Education - 20th International Conference, AIED 2019, Proceedings (pp. 270-282). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11625 LNAI). Springer Verlag. https://doi.org/10.1007/978-3-030-23204-7_23

Checking it twice : Does adding spelling and grammar checkers improve essay quality in an automated writing tutor? / McCarthy, Kathryn S.; Roscoe, Rod; Likens, Aaron D.; McNamara, Danielle.

Artificial Intelligence in Education - 20th International Conference, AIED 2019, Proceedings. ed. / Seiji Isotani; Peter Hastings; Amy Ogan; Bruce McLaren; Eva Millán; Rose Luckin. Springer Verlag, 2019. p. 270-282 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11625 LNAI).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

McCarthy, KS, Roscoe, R, Likens, AD & McNamara, D 2019, Checking it twice: Does adding spelling and grammar checkers improve essay quality in an automated writing tutor? in S Isotani, P Hastings, A Ogan, B McLaren, E Millán & R Luckin (eds), Artificial Intelligence in Education - 20th International Conference, AIED 2019, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11625 LNAI, Springer Verlag, pp. 270-282, 20th International Conference on Artificial Intelligence in Education, AIED 2019, Chicago, United States, 6/25/19. https://doi.org/10.1007/978-3-030-23204-7_23
McCarthy KS, Roscoe R, Likens AD, McNamara D. Checking it twice: Does adding spelling and grammar checkers improve essay quality in an automated writing tutor? In Isotani S, Hastings P, Ogan A, McLaren B, Millán E, Luckin R, editors, Artificial Intelligence in Education - 20th International Conference, AIED 2019, Proceedings. Springer Verlag. 2019. p. 270-282. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-030-23204-7_23
McCarthy, Kathryn S. ; Roscoe, Rod ; Likens, Aaron D. ; McNamara, Danielle. / Checking it twice : Does adding spelling and grammar checkers improve essay quality in an automated writing tutor?. Artificial Intelligence in Education - 20th International Conference, AIED 2019, Proceedings. editor / Seiji Isotani ; Peter Hastings ; Amy Ogan ; Bruce McLaren ; Eva Millán ; Rose Luckin. Springer Verlag, 2019. pp. 270-282 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{9b76b53451ea4758ab4be05eff3180c8,
title = "Checking it twice: Does adding spelling and grammar checkers improve essay quality in an automated writing tutor?",
abstract = "This study investigated the effect of incorporating spelling and grammar checking tools within an automated writing tutoring system, Writing Pal. High school students (n = 119) wrote and revised six persuasive essays. After initial drafts, all students received formative feedback about writing strategies. Half of the participants were also given access to spelling and grammar checking tools during the writing and revision periods. Linear mixed effects models revealed that essay quality for students in both conditions improved from initial draft to revision in terms of all aspects except essay unity. The availability of spelling and grammar checking yielded added improvements from initial draft to revision for several aspects of essay quality (i.e., conclusion, organization, voice, grammar/mechanics, and word choice), but other aspects were unaffected (i.e., introduction, body, unity, and sentence structure). The availability of spelling and grammar checking tools had no effect on holistic essay scores. These results indicate that automated spelling and grammar feedback contribute to modest, incremental improvements in writing quality that may complement automated strategy feedback.",
keywords = "Automated writing evaluation, Feedback, Natural language processing, Spelling and grammar checking, Writing strategies",
author = "McCarthy, {Kathryn S.} and Rod Roscoe and Likens, {Aaron D.} and Danielle McNamara",
year = "2019",
month = "1",
day = "1",
doi = "10.1007/978-3-030-23204-7_23",
language = "English (US)",
isbn = "9783030232030",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "270--282",
editor = "Seiji Isotani and Peter Hastings and Amy Ogan and Bruce McLaren and Eva Mill{\'a}n and Rose Luckin",
booktitle = "Artificial Intelligence in Education - 20th International Conference, AIED 2019, Proceedings",

}

TY - GEN

T1 - Checking it twice

T2 - Does adding spelling and grammar checkers improve essay quality in an automated writing tutor?

AU - McCarthy, Kathryn S.

AU - Roscoe, Rod

AU - Likens, Aaron D.

AU - McNamara, Danielle

PY - 2019/1/1

Y1 - 2019/1/1

N2 - This study investigated the effect of incorporating spelling and grammar checking tools within an automated writing tutoring system, Writing Pal. High school students (n = 119) wrote and revised six persuasive essays. After initial drafts, all students received formative feedback about writing strategies. Half of the participants were also given access to spelling and grammar checking tools during the writing and revision periods. Linear mixed effects models revealed that essay quality for students in both conditions improved from initial draft to revision in terms of all aspects except essay unity. The availability of spelling and grammar checking yielded added improvements from initial draft to revision for several aspects of essay quality (i.e., conclusion, organization, voice, grammar/mechanics, and word choice), but other aspects were unaffected (i.e., introduction, body, unity, and sentence structure). The availability of spelling and grammar checking tools had no effect on holistic essay scores. These results indicate that automated spelling and grammar feedback contribute to modest, incremental improvements in writing quality that may complement automated strategy feedback.

AB - This study investigated the effect of incorporating spelling and grammar checking tools within an automated writing tutoring system, Writing Pal. High school students (n = 119) wrote and revised six persuasive essays. After initial drafts, all students received formative feedback about writing strategies. Half of the participants were also given access to spelling and grammar checking tools during the writing and revision periods. Linear mixed effects models revealed that essay quality for students in both conditions improved from initial draft to revision in terms of all aspects except essay unity. The availability of spelling and grammar checking yielded added improvements from initial draft to revision for several aspects of essay quality (i.e., conclusion, organization, voice, grammar/mechanics, and word choice), but other aspects were unaffected (i.e., introduction, body, unity, and sentence structure). The availability of spelling and grammar checking tools had no effect on holistic essay scores. These results indicate that automated spelling and grammar feedback contribute to modest, incremental improvements in writing quality that may complement automated strategy feedback.

KW - Automated writing evaluation

KW - Feedback

KW - Natural language processing

KW - Spelling and grammar checking

KW - Writing strategies

UR - http://www.scopus.com/inward/record.url?scp=85068341457&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85068341457&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-23204-7_23

DO - 10.1007/978-3-030-23204-7_23

M3 - Conference contribution

AN - SCOPUS:85068341457

SN - 9783030232030

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 270

EP - 282

BT - Artificial Intelligence in Education - 20th International Conference, AIED 2019, Proceedings

A2 - Isotani, Seiji

A2 - Hastings, Peter

A2 - Ogan, Amy

A2 - McLaren, Bruce

A2 - Millán, Eva

A2 - Luckin, Rose

PB - Springer Verlag

ER -