This report provides a two-part evaluation of the IntelliMetric[SM] automated essay scoring system based on its performance scoring essays from the Analytic Writing Assessment of the Graduate Management Admission Test[TM] (GMAT[TM]). The IntelliMetric system performance is first compared to that of individual human raters, a Bayesian system…

This paper examines how institutions of higher education might operationalize faculty performance evaluation in terms of research, teaching, and university and community service. An analytic hierarchy process model is developed and presented, allowing decision makers to couple performance evaluation and academic reward/awards and recognitions…

A marked difference in the quality of reading lesson plans after early childhood education students were required to use the Unit Builder feature in a web-based productivity tool (TaskStream) prompted the design of a study to measure significant changes. A rubric was created that meshed the qualities of effective teachers of literacy and the…

We report an experiment examining the academic performance of undergraduate students in two special education college courses. The experimenter/professor taught both courses in which he presented curriculum material via written learn units (LUs) (Greer & Hogin, 1999) or in a lecture format across randomly selected weeks in a 12-week semester.…

From a larger longitudinal study of 610 fourth graders in 17 inner city schools, 40 students were randomly selected from 10 classrooms rated high (i.e., top quartile) or low (i.e., bottom quartile) in quality of writing instruction in grades 3 and 4. The written compositions of these students were scored in three ways: (1) according to a rating…

Teachers and administrators of Ogden Elementary School (Ogden, Kansas) had a problem--the school had had a pattern of poor student performance at least since 1991, when the Kansas State Assessment was implemented. Ogden had failed to reach the state standard of excellence (25% of tested students scoring in the "exemplary" category; 5% or…

This action research report describes a program to increase students' reading comprehension and fluency through the use of guided reading. The targeted population consists of second and fourth grade students in a northwest suburban area of a large city located in the Midwest. The problems of low reading comprehension and fluency scores were…

For many people committed to strong academic standards, the "advanced" high school courses offered through the College Board's Advanced Placement program and, increasingly, the Diploma Programme of the International Baccalaureate Organisation (IBO) represent the curricular gold standard for secondary education. Admissions directors and…

The purpose of the NMSBA technical report is to provide users and other interested parties with a general overview of and technical characteristics of the 2007 NMSBA. The 2007 technical report contains the following information: (1) Test development; (2) Scoring procedures; (3) Summary of student performance; (4) Statistical analyses of item and…

In this study, we investigated a variety of Reader effects that may influence the validity of ratings assigned to AP® English Literature and Composition essays. Specifically, we investigated whether Readers exhibit changes in their levels of severity and accuracy, and their use of individual scale categories over time. We refer to changes in these…

Secondary vocational-technical education programs in Mississippi are faced with many challenges resulting from sweeping educational reforms at the national and state levels. Schools and teachers are increasingly being held accountable for providing true learning activities to every student in the classroom. This accountability is measured through…

This proof-of-concept investigation describes a computer-based approach for deriving the knowledge structure of individuals and of groups from their written essays, and considers the convergent criterion-related validity of the computer-based scores relative to human rater essay scores and multiple-choice test scores. After completing a…

Secondary vocational-technical education programs in Mississippi are faced with many challenges resulting from sweeping educational reforms at the national and state levels. Schools and teachers are increasingly being held accountable for providing true learning activities to every student in the classroom. This accountability is measured through…

Student assessment, from the classroom to the state and national levels, is changing. The era of norm-referenced, multiple choice, standardized tests may be coming to an end, to be replaced by other forms of assessment, not all equally good. This guide outlines a vision of what assessment in the service of learning can be and provides ideas,…

A pilot validity study was conducted of the use of eighth-grade language arts portfolios for ninth-grade English placement decisions (academic or general) in a school district that consists of a city and an independent borough. Portfolios offered an opportunity to collect and examine multiple measures of performance for decisions previously made…