The halo effect is raters' undesirable tendency to assign more similar ratings across rating criteria than they should. The impacts of the halo effect on ratings have been studied in rater-mediated L2 writing assessment. Little is known, however, about the extent to which rating criteria order in analytic rating scales is associated with the…

Notable mean score differences for the "e-rater"® automated scoring engine and for humans for essays from certain demographic groups were observed for the "GRE"® General Test in use before the major revision of 2012, called rGRE. The use of e-rater as a check-score model with discrepancy thresholds prevented an adverse impact…

Different genres of writing entail various levels of syntactic and lexical complexity, and how this complexity influences the results of Automatic Writing Evaluation (AWE) programs like Grammarly in second language (L2) writing is unknown. This study explored the use of Grammarly in the L2 writing context by comparing error frequency, error types…

Worked examples, commonly used in technical domains, are rarely used in language areas such as English literature. In 3 experiments, Korean university students for whom English was a foreign language received worked examples intended to facilitate problem solving in the ill-structured domain of English literature. During the learning phase, half…

Using a recruitment test for Korean teachers, the use of the Rasch measurement model to control the effects of judge variable on the grading of essay-type items is examined. Ways of minimizing the variation of grading due to judge severity and reducing the number of judges without threatening objectivity of ability measurements are presented.…