Computationally assessing expert judgments of freewriting quality

This study examines the relationship between the linguistic features of freewrites and human assessments of freewrite quality. Freewriting is a prewriting strategy that has received little experimental attention, particularly in terms of linguistic differences between high and low quality freewrites. This study builds upon the authors' previous study, in which linguistic features of freewrites written by 9^th and 11^th grade students were included in a model of the freewrites' quality (Weston, Crossley, & McNamara; 2010). The current study reexamines this model using a larger data set of freewrites. The results show that similar linguistic features reported in the Weston et al. model positively correlate with expert ratings in the new data set. Significant predictors in the current model of freewrite quality were total number of words and stem overlap. In addition, analyses suggest that 11^th graders, as compared to 9^th graders, wrote higher quality and longer freewrites. Overall, the results of this study support the conclusion that better freewrites are longer and more cohesive than poor freewrites.