Recent reviews of automated writing evaluation systems indicate lack of uniformity in the purpose, design, and assessment of such systems. Our work lies at the nexus of critical themes arising from these reviews. We describe our work on eRevise, an automated writing evaluation system focused on elementary students' text-based evidence-use. eRevise…

The amount of research evaluating the technical merits of general outcome measures of science and social studies achievement is growing. This study targeted criterion validity for critical content monitoring. Questions addressed the concurrent criterion validity of alternate presentation formats of critical content monitoring and the measure's…

We conducted conceptual replications for an online-administered general outcome measure known as critical content monitoring in science. Totally, 547 Grades 4 to 6 students from a rural Louisiana school district participated. Research questions addressed criterion validity, diagnostic accuracy, growth, and social validity concerns. Criterion…

The purpose of this study was to evaluate technical adequacy features of an online adaptation of vocabulary matching known as critical content monitoring. Validity and reliability studies were conducted with a sample of 106 students from one school in fifth-grade science content. Participants were administered 20 parallel forms of the general…

The authors revised and validated the New Ecological Paradigm (NEP) Scale for use with upper elementary students. Researchers use the NEP Scale extensively with adults, but it was not designed for children. Interviews with 5th grade students helped the authors revise the NEP Scale for use with children. The authors spent 2 years validating the…

Curriculum-based measurement (CBM) is a well established tool for formative assessment. CBM has also been used for prediction of state test scores. However, validity coefficients between math-CBM and state tests have been moderate at best (Skiba, Magnusson, Martson, and Erickson, 1986; Martson, 1989; Putnam, 1989). The purpose of the present…