Automatic assessment of constructed response data in a chemistry tutor

Scott Crossley, Kristopher Kyle, Jodi Davenport, Danielle McNamara

Research output: Contribution to conferencePaper

4 Citations (Scopus)

Abstract

This study introduces the Constructed Response Analysis Tool (CRAT), a freely available tool to automatically assess student responses in online tutoring systems. The study tests CRAT on a dataset of chemistry responses collected in the ChemVLab+. The findings indicate that CRAT can differentiate and classify student responses based on semantic overlap with student input and indices related to word frequency, text content, and lexical sophistication. Overall, the findings suggest that more accurate student responses show greater overlap with the content learned, include more academic function words, contain greater content that is descriptive, and includes more specific and familiar words.

Original languageEnglish (US)
Pages336-340
Number of pages5
StatePublished - Jan 1 2016
Event9th International Conference on Educational Data Mining, EDM 2016 - Raleigh, United States
Duration: Jun 29 2016Jul 2 2016

Conference

Conference9th International Conference on Educational Data Mining, EDM 2016
CountryUnited States
CityRaleigh
Period6/29/167/2/16

Fingerprint

Students
Online systems
Semantics

Keywords

  • Constructed response scoring
  • Natural language processing
  • On-line tutors

ASJC Scopus subject areas

  • Computer Science Applications
  • Information Systems

Cite this

Crossley, S., Kyle, K., Davenport, J., & McNamara, D. (2016). Automatic assessment of constructed response data in a chemistry tutor. 336-340. Paper presented at 9th International Conference on Educational Data Mining, EDM 2016, Raleigh, United States.

Automatic assessment of constructed response data in a chemistry tutor. / Crossley, Scott; Kyle, Kristopher; Davenport, Jodi; McNamara, Danielle.

2016. 336-340 Paper presented at 9th International Conference on Educational Data Mining, EDM 2016, Raleigh, United States.

Research output: Contribution to conferencePaper

Crossley, S, Kyle, K, Davenport, J & McNamara, D 2016, 'Automatic assessment of constructed response data in a chemistry tutor' Paper presented at 9th International Conference on Educational Data Mining, EDM 2016, Raleigh, United States, 6/29/16 - 7/2/16, pp. 336-340.
Crossley S, Kyle K, Davenport J, McNamara D. Automatic assessment of constructed response data in a chemistry tutor. 2016. Paper presented at 9th International Conference on Educational Data Mining, EDM 2016, Raleigh, United States.
Crossley, Scott ; Kyle, Kristopher ; Davenport, Jodi ; McNamara, Danielle. / Automatic assessment of constructed response data in a chemistry tutor. Paper presented at 9th International Conference on Educational Data Mining, EDM 2016, Raleigh, United States.5 p.
@conference{47c9e868043c46e2b1549e0a909c2559,
title = "Automatic assessment of constructed response data in a chemistry tutor",
abstract = "This study introduces the Constructed Response Analysis Tool (CRAT), a freely available tool to automatically assess student responses in online tutoring systems. The study tests CRAT on a dataset of chemistry responses collected in the ChemVLab+. The findings indicate that CRAT can differentiate and classify student responses based on semantic overlap with student input and indices related to word frequency, text content, and lexical sophistication. Overall, the findings suggest that more accurate student responses show greater overlap with the content learned, include more academic function words, contain greater content that is descriptive, and includes more specific and familiar words.",
keywords = "Constructed response scoring, Natural language processing, On-line tutors",
author = "Scott Crossley and Kristopher Kyle and Jodi Davenport and Danielle McNamara",
year = "2016",
month = "1",
day = "1",
language = "English (US)",
pages = "336--340",
note = "9th International Conference on Educational Data Mining, EDM 2016 ; Conference date: 29-06-2016 Through 02-07-2016",

}

TY - CONF

T1 - Automatic assessment of constructed response data in a chemistry tutor

AU - Crossley, Scott

AU - Kyle, Kristopher

AU - Davenport, Jodi

AU - McNamara, Danielle

PY - 2016/1/1

Y1 - 2016/1/1

N2 - This study introduces the Constructed Response Analysis Tool (CRAT), a freely available tool to automatically assess student responses in online tutoring systems. The study tests CRAT on a dataset of chemistry responses collected in the ChemVLab+. The findings indicate that CRAT can differentiate and classify student responses based on semantic overlap with student input and indices related to word frequency, text content, and lexical sophistication. Overall, the findings suggest that more accurate student responses show greater overlap with the content learned, include more academic function words, contain greater content that is descriptive, and includes more specific and familiar words.

AB - This study introduces the Constructed Response Analysis Tool (CRAT), a freely available tool to automatically assess student responses in online tutoring systems. The study tests CRAT on a dataset of chemistry responses collected in the ChemVLab+. The findings indicate that CRAT can differentiate and classify student responses based on semantic overlap with student input and indices related to word frequency, text content, and lexical sophistication. Overall, the findings suggest that more accurate student responses show greater overlap with the content learned, include more academic function words, contain greater content that is descriptive, and includes more specific and familiar words.

KW - Constructed response scoring

KW - Natural language processing

KW - On-line tutors

UR - http://www.scopus.com/inward/record.url?scp=85022226867&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85022226867&partnerID=8YFLogxK

M3 - Paper

AN - SCOPUS:85022226867

SP - 336

EP - 340

ER -