65 Citations (Scopus)

Abstract

The Writing Pal (W-Pal) is a novel intelligent tutoring system (ITS) that offers writing strategy instruction, game-based practice, essay writing practice, and formative feedback to developing writers. Compared to more tractable and constrained learning domains for ITS, writing is an ill-defined domain because the features of effective writing are difficult to quantify and individual writers can employ diverse strategies to achieve similar goals. The development of an ITS in an ill-defined domain presents particular challenges regarding comprehensive instruction, modularized content, extended practice, and formative feedback. In this article, we describe how the development of W-Pal has uniquely addressed these concerns and present the results of a study assessing the feasibility of this system in high school English classrooms. This study included 2 teachers and their 141 10th grade English class students who utilized W-Pal over a 6-month period during the academic year. Log-file analyses showed that students used all aspects of W-Pal, but activity and engagement was uneven throughout the year and decreased over time. Essay scores improved over time and surveys indicated that students perceived the lessons, games, and feedback as beneficial. However, specific aspects of the learning environment were critiqued as annoying, challenging, or lacking specificity. Overall, the results suggest that the system was generally well-received by the students but also offer insights for the development of ITSs in ill-defined domains.

Original languageEnglish (US)
Pages (from-to)1010-1025
Number of pages16
JournalJournal of Educational Psychology
Volume105
Issue number4
DOIs
StatePublished - Nov 2013

Fingerprint

tutor
classroom
school
Students
student
writer
Learning
instruction
Feasibility Studies
learning environment
school grade
teacher
learning
Practice (Psychology)

Keywords

  • Ill-defined learning domains
  • Intelligent tutoring systems
  • Usability and feasibility testing
  • Writing instruction

ASJC Scopus subject areas

  • Developmental and Educational Psychology
  • Education

Cite this

@article{19b2a606b80e4eaea36b3ace4e45c719,
title = "Writing pal: Feasibility of an intelligent writing strategy tutor in the high school classroom",
abstract = "The Writing Pal (W-Pal) is a novel intelligent tutoring system (ITS) that offers writing strategy instruction, game-based practice, essay writing practice, and formative feedback to developing writers. Compared to more tractable and constrained learning domains for ITS, writing is an ill-defined domain because the features of effective writing are difficult to quantify and individual writers can employ diverse strategies to achieve similar goals. The development of an ITS in an ill-defined domain presents particular challenges regarding comprehensive instruction, modularized content, extended practice, and formative feedback. In this article, we describe how the development of W-Pal has uniquely addressed these concerns and present the results of a study assessing the feasibility of this system in high school English classrooms. This study included 2 teachers and their 141 10th grade English class students who utilized W-Pal over a 6-month period during the academic year. Log-file analyses showed that students used all aspects of W-Pal, but activity and engagement was uneven throughout the year and decreased over time. Essay scores improved over time and surveys indicated that students perceived the lessons, games, and feedback as beneficial. However, specific aspects of the learning environment were critiqued as annoying, challenging, or lacking specificity. Overall, the results suggest that the system was generally well-received by the students but also offer insights for the development of ITSs in ill-defined domains.",
keywords = "Ill-defined learning domains, Intelligent tutoring systems, Usability and feasibility testing, Writing instruction",
author = "Rod Roscoe and Danielle McNamara",
year = "2013",
month = "11",
doi = "10.1037/a0032340",
language = "English (US)",
volume = "105",
pages = "1010--1025",
journal = "Journal of Educational Psychology",
issn = "0022-0663",
publisher = "American Psychological Association Inc.",
number = "4",

}

TY - JOUR

T1 - Writing pal

T2 - Feasibility of an intelligent writing strategy tutor in the high school classroom

AU - Roscoe, Rod

AU - McNamara, Danielle

PY - 2013/11

Y1 - 2013/11

N2 - The Writing Pal (W-Pal) is a novel intelligent tutoring system (ITS) that offers writing strategy instruction, game-based practice, essay writing practice, and formative feedback to developing writers. Compared to more tractable and constrained learning domains for ITS, writing is an ill-defined domain because the features of effective writing are difficult to quantify and individual writers can employ diverse strategies to achieve similar goals. The development of an ITS in an ill-defined domain presents particular challenges regarding comprehensive instruction, modularized content, extended practice, and formative feedback. In this article, we describe how the development of W-Pal has uniquely addressed these concerns and present the results of a study assessing the feasibility of this system in high school English classrooms. This study included 2 teachers and their 141 10th grade English class students who utilized W-Pal over a 6-month period during the academic year. Log-file analyses showed that students used all aspects of W-Pal, but activity and engagement was uneven throughout the year and decreased over time. Essay scores improved over time and surveys indicated that students perceived the lessons, games, and feedback as beneficial. However, specific aspects of the learning environment were critiqued as annoying, challenging, or lacking specificity. Overall, the results suggest that the system was generally well-received by the students but also offer insights for the development of ITSs in ill-defined domains.

AB - The Writing Pal (W-Pal) is a novel intelligent tutoring system (ITS) that offers writing strategy instruction, game-based practice, essay writing practice, and formative feedback to developing writers. Compared to more tractable and constrained learning domains for ITS, writing is an ill-defined domain because the features of effective writing are difficult to quantify and individual writers can employ diverse strategies to achieve similar goals. The development of an ITS in an ill-defined domain presents particular challenges regarding comprehensive instruction, modularized content, extended practice, and formative feedback. In this article, we describe how the development of W-Pal has uniquely addressed these concerns and present the results of a study assessing the feasibility of this system in high school English classrooms. This study included 2 teachers and their 141 10th grade English class students who utilized W-Pal over a 6-month period during the academic year. Log-file analyses showed that students used all aspects of W-Pal, but activity and engagement was uneven throughout the year and decreased over time. Essay scores improved over time and surveys indicated that students perceived the lessons, games, and feedback as beneficial. However, specific aspects of the learning environment were critiqued as annoying, challenging, or lacking specificity. Overall, the results suggest that the system was generally well-received by the students but also offer insights for the development of ITSs in ill-defined domains.

KW - Ill-defined learning domains

KW - Intelligent tutoring systems

KW - Usability and feasibility testing

KW - Writing instruction

UR - http://www.scopus.com/inward/record.url?scp=84887543012&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84887543012&partnerID=8YFLogxK

U2 - 10.1037/a0032340

DO - 10.1037/a0032340

M3 - Article

VL - 105

SP - 1010

EP - 1025

JO - Journal of Educational Psychology

JF - Journal of Educational Psychology

SN - 0022-0663

IS - 4

ER -