Effects of error messages on students' ability to understand and fix programming errors

Harsha B.M. Kadekar, Sohum Sohoni, Scotty Craig

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    The role of error messages in the context of teaching programming, specifically assembly language programming to students who have limited prior programming experience was investigated. Assemblers and compilers provide feedback to a programmer in the form of error messages, and these error messages influence the programmer's mental model of computing. The current study investigated how an error message affects students' approach to understanding the error and fixing the error. Three error message types were developed - Default, Link and Example, to better understand the effects of error messages. The Default type provides an assembler-centric single line error message, the Link type provides a program-centric detailed error description with a hyperlink for more information, and the Example type provides a program-centric detailed error description with a relevant example. A think aloud programming exercise was conducted to capture the student programmer's knowledge model. Different codes were developed to analyze the data collected as part of think aloud exercise. After transcribing, coding, and analyzing the data, it was found that the Link type of error message helped to fix the error in less time and with fewer steps. Among the three types, the Link type of error message also resulted in a higher ratio of correct to incorrect hypotheses made by the participants, and a correspondingly higher ratio of correct to incorrect steps taken by them to fix the error.

    Original languageEnglish (US)
    Title of host publicationFrontiers in Education
    Subtitle of host publicationFostering Innovation Through Diversity, FIE 2018 - Conference Proceedings
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    ISBN (Electronic)9781538611739
    DOIs
    StatePublished - Mar 4 2019
    Event48th Frontiers in Education Conference, FIE 2018 - San Jose, United States
    Duration: Oct 3 2018Oct 6 2018

    Publication series

    NameProceedings - Frontiers in Education Conference, FIE
    Volume2018-October
    ISSN (Print)1539-4565

    Conference

    Conference48th Frontiers in Education Conference, FIE 2018
    CountryUnited States
    CitySan Jose
    Period10/3/1810/6/18

    Fingerprint

    programming
    Students
    ability
    student
    Computer programming
    programming language
    Computer programming languages
    coding
    Teaching
    Feedback

    Keywords

    • Component
    • Formatting
    • Insert (key words)
    • Style
    • Styling

    ASJC Scopus subject areas

    • Software
    • Education
    • Computer Science Applications

    Cite this

    Kadekar, H. B. M., Sohoni, S., & Craig, S. (2019). Effects of error messages on students' ability to understand and fix programming errors. In Frontiers in Education: Fostering Innovation Through Diversity, FIE 2018 - Conference Proceedings [8658629] (Proceedings - Frontiers in Education Conference, FIE; Vol. 2018-October). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/FIE.2018.8658629

    Effects of error messages on students' ability to understand and fix programming errors. / Kadekar, Harsha B.M.; Sohoni, Sohum; Craig, Scotty.

    Frontiers in Education: Fostering Innovation Through Diversity, FIE 2018 - Conference Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. 8658629 (Proceedings - Frontiers in Education Conference, FIE; Vol. 2018-October).

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Kadekar, HBM, Sohoni, S & Craig, S 2019, Effects of error messages on students' ability to understand and fix programming errors. in Frontiers in Education: Fostering Innovation Through Diversity, FIE 2018 - Conference Proceedings., 8658629, Proceedings - Frontiers in Education Conference, FIE, vol. 2018-October, Institute of Electrical and Electronics Engineers Inc., 48th Frontiers in Education Conference, FIE 2018, San Jose, United States, 10/3/18. https://doi.org/10.1109/FIE.2018.8658629
    Kadekar HBM, Sohoni S, Craig S. Effects of error messages on students' ability to understand and fix programming errors. In Frontiers in Education: Fostering Innovation Through Diversity, FIE 2018 - Conference Proceedings. Institute of Electrical and Electronics Engineers Inc. 2019. 8658629. (Proceedings - Frontiers in Education Conference, FIE). https://doi.org/10.1109/FIE.2018.8658629
    Kadekar, Harsha B.M. ; Sohoni, Sohum ; Craig, Scotty. / Effects of error messages on students' ability to understand and fix programming errors. Frontiers in Education: Fostering Innovation Through Diversity, FIE 2018 - Conference Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. (Proceedings - Frontiers in Education Conference, FIE).
    @inproceedings{36b610983dca4d88a44475feb4db341c,
    title = "Effects of error messages on students' ability to understand and fix programming errors",
    abstract = "The role of error messages in the context of teaching programming, specifically assembly language programming to students who have limited prior programming experience was investigated. Assemblers and compilers provide feedback to a programmer in the form of error messages, and these error messages influence the programmer's mental model of computing. The current study investigated how an error message affects students' approach to understanding the error and fixing the error. Three error message types were developed - Default, Link and Example, to better understand the effects of error messages. The Default type provides an assembler-centric single line error message, the Link type provides a program-centric detailed error description with a hyperlink for more information, and the Example type provides a program-centric detailed error description with a relevant example. A think aloud programming exercise was conducted to capture the student programmer's knowledge model. Different codes were developed to analyze the data collected as part of think aloud exercise. After transcribing, coding, and analyzing the data, it was found that the Link type of error message helped to fix the error in less time and with fewer steps. Among the three types, the Link type of error message also resulted in a higher ratio of correct to incorrect hypotheses made by the participants, and a correspondingly higher ratio of correct to incorrect steps taken by them to fix the error.",
    keywords = "Component, Formatting, Insert (key words), Style, Styling",
    author = "Kadekar, {Harsha B.M.} and Sohum Sohoni and Scotty Craig",
    year = "2019",
    month = "3",
    day = "4",
    doi = "10.1109/FIE.2018.8658629",
    language = "English (US)",
    series = "Proceedings - Frontiers in Education Conference, FIE",
    publisher = "Institute of Electrical and Electronics Engineers Inc.",
    booktitle = "Frontiers in Education",

    }

    TY - GEN

    T1 - Effects of error messages on students' ability to understand and fix programming errors

    AU - Kadekar, Harsha B.M.

    AU - Sohoni, Sohum

    AU - Craig, Scotty

    PY - 2019/3/4

    Y1 - 2019/3/4

    N2 - The role of error messages in the context of teaching programming, specifically assembly language programming to students who have limited prior programming experience was investigated. Assemblers and compilers provide feedback to a programmer in the form of error messages, and these error messages influence the programmer's mental model of computing. The current study investigated how an error message affects students' approach to understanding the error and fixing the error. Three error message types were developed - Default, Link and Example, to better understand the effects of error messages. The Default type provides an assembler-centric single line error message, the Link type provides a program-centric detailed error description with a hyperlink for more information, and the Example type provides a program-centric detailed error description with a relevant example. A think aloud programming exercise was conducted to capture the student programmer's knowledge model. Different codes were developed to analyze the data collected as part of think aloud exercise. After transcribing, coding, and analyzing the data, it was found that the Link type of error message helped to fix the error in less time and with fewer steps. Among the three types, the Link type of error message also resulted in a higher ratio of correct to incorrect hypotheses made by the participants, and a correspondingly higher ratio of correct to incorrect steps taken by them to fix the error.

    AB - The role of error messages in the context of teaching programming, specifically assembly language programming to students who have limited prior programming experience was investigated. Assemblers and compilers provide feedback to a programmer in the form of error messages, and these error messages influence the programmer's mental model of computing. The current study investigated how an error message affects students' approach to understanding the error and fixing the error. Three error message types were developed - Default, Link and Example, to better understand the effects of error messages. The Default type provides an assembler-centric single line error message, the Link type provides a program-centric detailed error description with a hyperlink for more information, and the Example type provides a program-centric detailed error description with a relevant example. A think aloud programming exercise was conducted to capture the student programmer's knowledge model. Different codes were developed to analyze the data collected as part of think aloud exercise. After transcribing, coding, and analyzing the data, it was found that the Link type of error message helped to fix the error in less time and with fewer steps. Among the three types, the Link type of error message also resulted in a higher ratio of correct to incorrect hypotheses made by the participants, and a correspondingly higher ratio of correct to incorrect steps taken by them to fix the error.

    KW - Component

    KW - Formatting

    KW - Insert (key words)

    KW - Style

    KW - Styling

    UR - http://www.scopus.com/inward/record.url?scp=85063475181&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85063475181&partnerID=8YFLogxK

    U2 - 10.1109/FIE.2018.8658629

    DO - 10.1109/FIE.2018.8658629

    M3 - Conference contribution

    T3 - Proceedings - Frontiers in Education Conference, FIE

    BT - Frontiers in Education

    PB - Institute of Electrical and Electronics Engineers Inc.

    ER -