In a randomized trial that collects text as an outcome, traditional approaches for assessing treatment impact require that each document first be manually coded for constructs of interest by human raters. An impact analysis can then be conducted to compare treatment and control groups, using the hand-coded scores as a measured outcome. This…

Background: Many in education argue for the importance of incorporating teacher judgements in the assessment and reporting of student performance. Advocates of such an approach are cognisant, though, that obtaining a satisfactory level of consistency in teacher judgements poses a challenge. Purpose: This study investigates the extent to which the…

Determining what constitutes good writing is difficult, though many say they know it when they see it. Although this approach may have support in the literature, there are other efficient and valid ways to assess students' writing. To obtain a complete picture of a student's writing skills, it is important that teachers take a balanced approach to…