Assessing Lexical Proficiency Using Analytic Ratings: A Case for Collocation Accuracy

Scott A. Crossley, Tom Salsbury, Danielle McNamara

Research output: Contribution to journalArticle

39 Citations (Scopus)

Abstract

This study analyzes lexical proficiency in oral and written texts produced by second language (L2) learners of English. The purpose of the study is to examine relationships between analytic scores of depth of lexical knowledge, breadth of lexical knowledge, and access to core lexical items and holistic scores of lexical proficiency. A corpus of 240 spoken texts and 240 written texts produced by beginning L2 learners, intermediate L2 learners, advanced L2 learners, and native speakers were scored for both analytic and holistic features of lexical proficiency by trained raters. Using a multiple regression analysis, the study found that collocation accuracy, lexical diversity, and word frequency are significant predictors of human evaluations of lexical proficiency. Collocation accuracy explained the greatest amount of variance in the holistic scores (84% in the written samples and 89% in the spoken samples). The authors discuss the importance of collocation accuracy in predicting human judgments of lexical proficiency.

Original languageEnglish (US)
Pages (from-to)570-590
Number of pages21
JournalApplied Linguistics
Volume36
Issue number5
DOIs
StatePublished - Dec 1 2015

Fingerprint

Regression analysis
rating
regression analysis
language
evaluation
Lexical Proficiency
Collocation
Rating
L2 Learners
Lexical Knowledge

ASJC Scopus subject areas

  • Linguistics and Language
  • Communication
  • Language and Linguistics

Cite this

Assessing Lexical Proficiency Using Analytic Ratings : A Case for Collocation Accuracy. / Crossley, Scott A.; Salsbury, Tom; McNamara, Danielle.

In: Applied Linguistics, Vol. 36, No. 5, 01.12.2015, p. 570-590.

Research output: Contribution to journalArticle

@article{79c5b0185a994d2bbd075714e259fbdc,
title = "Assessing Lexical Proficiency Using Analytic Ratings: A Case for Collocation Accuracy",
abstract = "This study analyzes lexical proficiency in oral and written texts produced by second language (L2) learners of English. The purpose of the study is to examine relationships between analytic scores of depth of lexical knowledge, breadth of lexical knowledge, and access to core lexical items and holistic scores of lexical proficiency. A corpus of 240 spoken texts and 240 written texts produced by beginning L2 learners, intermediate L2 learners, advanced L2 learners, and native speakers were scored for both analytic and holistic features of lexical proficiency by trained raters. Using a multiple regression analysis, the study found that collocation accuracy, lexical diversity, and word frequency are significant predictors of human evaluations of lexical proficiency. Collocation accuracy explained the greatest amount of variance in the holistic scores (84{\%} in the written samples and 89{\%} in the spoken samples). The authors discuss the importance of collocation accuracy in predicting human judgments of lexical proficiency.",
author = "Crossley, {Scott A.} and Tom Salsbury and Danielle McNamara",
year = "2015",
month = "12",
day = "1",
doi = "10.1093/applin/amt056",
language = "English (US)",
volume = "36",
pages = "570--590",
journal = "Applied Linguistics",
issn = "0142-6001",
publisher = "Oxford University Press",
number = "5",

}

TY - JOUR

T1 - Assessing Lexical Proficiency Using Analytic Ratings

T2 - A Case for Collocation Accuracy

AU - Crossley, Scott A.

AU - Salsbury, Tom

AU - McNamara, Danielle

PY - 2015/12/1

Y1 - 2015/12/1

N2 - This study analyzes lexical proficiency in oral and written texts produced by second language (L2) learners of English. The purpose of the study is to examine relationships between analytic scores of depth of lexical knowledge, breadth of lexical knowledge, and access to core lexical items and holistic scores of lexical proficiency. A corpus of 240 spoken texts and 240 written texts produced by beginning L2 learners, intermediate L2 learners, advanced L2 learners, and native speakers were scored for both analytic and holistic features of lexical proficiency by trained raters. Using a multiple regression analysis, the study found that collocation accuracy, lexical diversity, and word frequency are significant predictors of human evaluations of lexical proficiency. Collocation accuracy explained the greatest amount of variance in the holistic scores (84% in the written samples and 89% in the spoken samples). The authors discuss the importance of collocation accuracy in predicting human judgments of lexical proficiency.

AB - This study analyzes lexical proficiency in oral and written texts produced by second language (L2) learners of English. The purpose of the study is to examine relationships between analytic scores of depth of lexical knowledge, breadth of lexical knowledge, and access to core lexical items and holistic scores of lexical proficiency. A corpus of 240 spoken texts and 240 written texts produced by beginning L2 learners, intermediate L2 learners, advanced L2 learners, and native speakers were scored for both analytic and holistic features of lexical proficiency by trained raters. Using a multiple regression analysis, the study found that collocation accuracy, lexical diversity, and word frequency are significant predictors of human evaluations of lexical proficiency. Collocation accuracy explained the greatest amount of variance in the holistic scores (84% in the written samples and 89% in the spoken samples). The authors discuss the importance of collocation accuracy in predicting human judgments of lexical proficiency.

UR - http://www.scopus.com/inward/record.url?scp=84950276932&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84950276932&partnerID=8YFLogxK

U2 - 10.1093/applin/amt056

DO - 10.1093/applin/amt056

M3 - Article

AN - SCOPUS:84950276932

VL - 36

SP - 570

EP - 590

JO - Applied Linguistics

JF - Applied Linguistics

SN - 0142-6001

IS - 5

ER -