Effects of error messages on students' ability to understand and fix programming errors

Harsha B.M. Kadekar, Sohum Sohoni, Scotty Craig

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The role of error messages in the context of teaching programming, specifically assembly language programming to students who have limited prior programming experience was investigated. Assemblers and compilers provide feedback to a programmer in the form of error messages, and these error messages influence the programmer's mental model of computing. The current study investigated how an error message affects students' approach to understanding the error and fixing the error. Three error message types were developed - Default, Link and Example, to better understand the effects of error messages. The Default type provides an assembler-centric single line error message, the Link type provides a program-centric detailed error description with a hyperlink for more information, and the Example type provides a program-centric detailed error description with a relevant example. A think aloud programming exercise was conducted to capture the student programmer's knowledge model. Different codes were developed to analyze the data collected as part of think aloud exercise. After transcribing, coding, and analyzing the data, it was found that the Link type of error message helped to fix the error in less time and with fewer steps. Among the three types, the Link type of error message also resulted in a higher ratio of correct to incorrect hypotheses made by the participants, and a correspondingly higher ratio of correct to incorrect steps taken by them to fix the error.

Original languageEnglish (US)
Title of host publicationFrontiers in Education
Subtitle of host publicationFostering Innovation Through Diversity, FIE 2018 - Conference Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538611739
DOIs
StatePublished - Mar 4 2019
Externally publishedYes
Event48th Frontiers in Education Conference, FIE 2018 - San Jose, United States
Duration: Oct 3 2018Oct 6 2018

Publication series

NameProceedings - Frontiers in Education Conference, FIE
Volume2018-October
ISSN (Print)1539-4565

Conference

Conference48th Frontiers in Education Conference, FIE 2018
CountryUnited States
CitySan Jose
Period10/3/1810/6/18

Fingerprint

programming
Students
ability
student
Computer programming
programming language
Computer programming languages
coding
Teaching
Feedback

Keywords

  • Component
  • Formatting
  • Insert (key words)
  • Style
  • Styling

ASJC Scopus subject areas

  • Software
  • Education
  • Computer Science Applications

Cite this

Kadekar, H. B. M., Sohoni, S., & Craig, S. (2019). Effects of error messages on students' ability to understand and fix programming errors. In Frontiers in Education: Fostering Innovation Through Diversity, FIE 2018 - Conference Proceedings [8658629] (Proceedings - Frontiers in Education Conference, FIE; Vol. 2018-October). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/FIE.2018.8658629

Effects of error messages on students' ability to understand and fix programming errors. / Kadekar, Harsha B.M.; Sohoni, Sohum; Craig, Scotty.

Frontiers in Education: Fostering Innovation Through Diversity, FIE 2018 - Conference Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. 8658629 (Proceedings - Frontiers in Education Conference, FIE; Vol. 2018-October).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kadekar, HBM, Sohoni, S & Craig, S 2019, Effects of error messages on students' ability to understand and fix programming errors. in Frontiers in Education: Fostering Innovation Through Diversity, FIE 2018 - Conference Proceedings., 8658629, Proceedings - Frontiers in Education Conference, FIE, vol. 2018-October, Institute of Electrical and Electronics Engineers Inc., 48th Frontiers in Education Conference, FIE 2018, San Jose, United States, 10/3/18. https://doi.org/10.1109/FIE.2018.8658629
Kadekar HBM, Sohoni S, Craig S. Effects of error messages on students' ability to understand and fix programming errors. In Frontiers in Education: Fostering Innovation Through Diversity, FIE 2018 - Conference Proceedings. Institute of Electrical and Electronics Engineers Inc. 2019. 8658629. (Proceedings - Frontiers in Education Conference, FIE). https://doi.org/10.1109/FIE.2018.8658629
Kadekar, Harsha B.M. ; Sohoni, Sohum ; Craig, Scotty. / Effects of error messages on students' ability to understand and fix programming errors. Frontiers in Education: Fostering Innovation Through Diversity, FIE 2018 - Conference Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. (Proceedings - Frontiers in Education Conference, FIE).
@inproceedings{36b610983dca4d88a44475feb4db341c,
title = "Effects of error messages on students' ability to understand and fix programming errors",
abstract = "The role of error messages in the context of teaching programming, specifically assembly language programming to students who have limited prior programming experience was investigated. Assemblers and compilers provide feedback to a programmer in the form of error messages, and these error messages influence the programmer's mental model of computing. The current study investigated how an error message affects students' approach to understanding the error and fixing the error. Three error message types were developed - Default, Link and Example, to better understand the effects of error messages. The Default type provides an assembler-centric single line error message, the Link type provides a program-centric detailed error description with a hyperlink for more information, and the Example type provides a program-centric detailed error description with a relevant example. A think aloud programming exercise was conducted to capture the student programmer's knowledge model. Different codes were developed to analyze the data collected as part of think aloud exercise. After transcribing, coding, and analyzing the data, it was found that the Link type of error message helped to fix the error in less time and with fewer steps. Among the three types, the Link type of error message also resulted in a higher ratio of correct to incorrect hypotheses made by the participants, and a correspondingly higher ratio of correct to incorrect steps taken by them to fix the error.",
keywords = "Component, Formatting, Insert (key words), Style, Styling",
author = "Kadekar, {Harsha B.M.} and Sohum Sohoni and Scotty Craig",
year = "2019",
month = "3",
day = "4",
doi = "10.1109/FIE.2018.8658629",
language = "English (US)",
series = "Proceedings - Frontiers in Education Conference, FIE",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
booktitle = "Frontiers in Education",

}

TY - GEN

T1 - Effects of error messages on students' ability to understand and fix programming errors

AU - Kadekar, Harsha B.M.

AU - Sohoni, Sohum

AU - Craig, Scotty

PY - 2019/3/4

Y1 - 2019/3/4

N2 - The role of error messages in the context of teaching programming, specifically assembly language programming to students who have limited prior programming experience was investigated. Assemblers and compilers provide feedback to a programmer in the form of error messages, and these error messages influence the programmer's mental model of computing. The current study investigated how an error message affects students' approach to understanding the error and fixing the error. Three error message types were developed - Default, Link and Example, to better understand the effects of error messages. The Default type provides an assembler-centric single line error message, the Link type provides a program-centric detailed error description with a hyperlink for more information, and the Example type provides a program-centric detailed error description with a relevant example. A think aloud programming exercise was conducted to capture the student programmer's knowledge model. Different codes were developed to analyze the data collected as part of think aloud exercise. After transcribing, coding, and analyzing the data, it was found that the Link type of error message helped to fix the error in less time and with fewer steps. Among the three types, the Link type of error message also resulted in a higher ratio of correct to incorrect hypotheses made by the participants, and a correspondingly higher ratio of correct to incorrect steps taken by them to fix the error.

AB - The role of error messages in the context of teaching programming, specifically assembly language programming to students who have limited prior programming experience was investigated. Assemblers and compilers provide feedback to a programmer in the form of error messages, and these error messages influence the programmer's mental model of computing. The current study investigated how an error message affects students' approach to understanding the error and fixing the error. Three error message types were developed - Default, Link and Example, to better understand the effects of error messages. The Default type provides an assembler-centric single line error message, the Link type provides a program-centric detailed error description with a hyperlink for more information, and the Example type provides a program-centric detailed error description with a relevant example. A think aloud programming exercise was conducted to capture the student programmer's knowledge model. Different codes were developed to analyze the data collected as part of think aloud exercise. After transcribing, coding, and analyzing the data, it was found that the Link type of error message helped to fix the error in less time and with fewer steps. Among the three types, the Link type of error message also resulted in a higher ratio of correct to incorrect hypotheses made by the participants, and a correspondingly higher ratio of correct to incorrect steps taken by them to fix the error.

KW - Component

KW - Formatting

KW - Insert (key words)

KW - Style

KW - Styling

UR - http://www.scopus.com/inward/record.url?scp=85063475181&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85063475181&partnerID=8YFLogxK

U2 - 10.1109/FIE.2018.8658629

DO - 10.1109/FIE.2018.8658629

M3 - Conference contribution

AN - SCOPUS:85063475181

T3 - Proceedings - Frontiers in Education Conference, FIE

BT - Frontiers in Education

PB - Institute of Electrical and Electronics Engineers Inc.

ER -