The field of educational measurement has evolved considerably since the first doctoral programs were established. In response, programs have typically tacked on courses that address newly developed theories, methods, tools, and techniques. As our review of current programs evidences, this approach produces artificial distinctions among topics and…

Evaluating quality in early childhood education and care (ECEC) service internationally is increasingly important. Research to date indicates that it is "high-quality" programmes that boost and sustain children's achievement outcomes over time. There is also growing interest in the accountability of public funds used for ECEC…

Psychometric instruments have been underutilized by counselor educators in performance assessment and program evaluation efforts. As such, we conducted a review of the literature that revealed 41 instruments fit for such efforts. We described and critiqued these instruments along four dimensions--"Target Domain," "Format,"…

This article explores some general considerations bearing on the question of whether virtue can be measured. What is moral virtue? What are measurement and evaluation, and what do they presuppose about the nature of what is measured or evaluated? What are the prospective contexts of, and purposes for, measuring or evaluating virtue, and how would…

In this paper, we provide an overview of psychometric procedures and guidelines Educational Testing Service (ETS) uses to evaluate automated essay scoring for operational use. We briefly describe the e-rater system, the procedures and criteria used to evaluate e-rater, implications for a range of potential uses of e-rater, and directions for…

Since 2003, the Essential Skills Series training program developed by the Canadian Evaluation Society has been offered to more than 15 groups in the province of Quebec. The evaluations of these workshops were based on the participants' reactions collected by a Participant Feedback Questionnaire. This article describes the process used to assess…

Action Research on Measuring Literacy Programme Participants' Learning Outcomes (RAMAA) aims to develop, implement and collaborate on the creation of a methodological approach to measure acquired learning and study the various factors that influence its development. This report examines how RAMAA I has been implemented over the past four years in…

The Association to Advance Collegiate Schools of Business (AACSB) International's assurance of learning (AoL) standards require that schools develop a sophisticated continuous-improvement process. The authors review various assessment models and develop a practical, 6-step AoL model based on the literature and the authors' AoL-implementation…

The Adolescent Responses to Alcohol and Drug Offers Scale (ARADOS) is a self-report questionnaire designed to assess a respondent's anticipated emotional reactions and intended use of cognitive-behavioral refusal skills in response to an offer of alcohol or other drug. A sample of 267 students enrolled in the 11th and 12th grades of four public…

Reaction questionnaires administered at the conclusion of a training program are a common method of evaluation. Because such questionnaires are often constructed and analyzed in an ad hoc manner, their usefulness is often difficult to gauge. However, if properly constructed and analyzed, such instruments can help to make clear the strengths and…

With the high number of homeless, there is a critical need for rapid and accurate assessment of quality of life to assess program outcomes. The World Health Organization's WHOQOL-100 has demonstrated promise in accurately assessing quality-of-life in this population. However, its length may make large scale use impractical for working with a…

With the growing emphasis on accountability and evidence-based practice, evaluation has become increasingly important in the contexts in which educational psychologists (EPs) practice. This paper describes a Target Monitoring and Evaluation (TME) system, derived from Goal Attainment Scaling (GAS) which was developed to evaluate outcomes of a wide…

Treatment integrity (also referred to as "treatment fidelity," "intervention integrity," and "procedural reliability") is an important methodological concerning both research and practice because treatment integrity data are essential to making valid conclusions regarding treatment outcomes. Despite its relationship to validity, treatment…

This article evaluates the initial psychometric qualities of the School Counseling Program Evaluation Survey (SCoPES). SCoPES is a 64-item instrument designed to correspond to "The National Standards for School Counseling Programs" (Campbell & Dahir, 1997). Coefficient alphas on the overall score and the three subscales (i.e.,…

School-wide positive behavior support (SWPBS) has been implemented in more than 4,000 schools as a means of addressing problem behavior in a systemic fashion. Preliminary outcomes (e.g., office discipline referrals, suspensions) indicate the effectiveness of SWPBS in decreasing school-wide behavior problems and creating a positive school climate.…