Automated scoring models for the "e-rater"® scoring engine were built and evaluated for the "GRE"® argument and issue-writing tasks. Prompt-specific, generic, and generic with prompt-specific intercept scoring models were built and evaluation statistics such as weighted kappas, Pearson correlations, standardized difference in…

The Program Standards Evaluation System was developed in response to evaluation requirements in the 1973 Rehabilitation Act. The system includes procedures for using standards data to monitor and evaluate vocational rehabilitation (VR) service outcomes and outputs as well as standards on key procedural issues. The system includes procedures for…

Proper design analysis is indispensable to assure quality and reduce emergent costs due to faulty software. Teaching proper design verification skills early during pedagogical development is crucial, as such analysis is the only tractable way of resolving software problems early when they are easy to fix. The premise of the presented strategy is…

The development of a single value revision indicator which would utilize learner performance data obtained from a pretest-posttest design to rank a set of instructional modules as to their relative need for revision is discussed. A set of procedures was developed in connection with the implementation of the Production, Implementation, Evaluation,…

To improve Comprehensive Employment and Training Act (CETA) participant assessment systems in Virginia, a project identified assessment systems and techniques/tools used by prime sponsors and developed an assessment model. It also identified key personnel of educational institutions in the prime sponsor area. A mail survey was followed by on-site…

Twelve common errors which can invalidate an otherwise sound evaluation are identified, and ways to avoid them are presented. The hazards are: (1) grade-equivalent scores; (2) inappropriate statistical adjustments with nonequivalent control groups; (3) administering norm-referenced tests at inappropriate times of the school year; (4) inappropriate…

This paper presents the designs underlying an IPI approach to ninth grade science implemented in the Jamesville-DeWitt schools in New York State. Briefly described are the generalizable instructional model, evaluation systems for assessing individual performance and the effectiveness of the instructional program and the support systems which make…

Ninth grade Elementary Secondary Education Act (ESEA) Title I evaluation results in reading and English-writing projects were compared, using the RMC Model A with local empirical norms, Model A with national interpolated norms, and Model B. The Comprehensive Tests of Basic Skills (CTBS)--Total Reading and Total Language subtests--were administered…

The Comprehensive Achievement Monitoring (CAM) model for project evaluation is compared with the usual classroom testing and pretest-posttest approaches. All three techniques are described and then examined in detail with respect to their advantages and limitations. The resources of project CAM in the areas of urban education and computer software…

An application of evaluation methodology to innovative educational programs through a case study of a Chicago suburban high school program for alternative education is presented. The evaluation methodology encompasses the difficulty in combining comparative programs, individual-diagnostic, and individual developmental measures, the selection of…