Predicting second language writing proficiency in learner texts using computational tools

Yeon Joo Jung, Scott Crossley, Danielle McNamara

Research output: Contribution to journalArticle

2 Scopus citations

Abstract

This study explores whether linguistic features can predict second language writing proficiency in the Michigan English Language Assessment Battery (MELAB) writing tasks. Advanced computational tools were used to automatically assess linguistic features related to lexical sophistication, syntactic complexity, cohesion, and text structure of writing samples graded by expert raters. The findings of this study show that an analysis of linguistic features can be used to significantly predict human judgments of the essays for the MELAB writing tasks. Furthermore, the findings indicate the relative contribution of a range of linguistic features in MELAB essays to overall second language (L2) writing proficiency scores. For instance, linguistic features associated with text length and lexical sophistication were found to be more predictive of writing quality in MELAB than those associated with cohesion and syntactic complexity. This study has important implications for defining writing proficiency at different levels of achievement in L2 academic writing as well as improving the current MELAB rating scale and rater training practices. Directions for future research are also discussed.

Original languageEnglish (US)
Pages (from-to)37-52
Number of pages16
JournalJournal of Asia TEFL
Volume16
Issue number1
DOIs
StatePublished - Mar 1 2019

    Fingerprint

Keywords

  • Computational analysis
  • Linguistic features
  • Second language writing proficiency

ASJC Scopus subject areas

  • Education
  • Linguistics and Language

Cite this