Evidence-based assessment (EBA) requires that investigators employ scientific theories and research findings to guide decisions about what domains to measure, how and when to measure them, and how to make decisions and interpret results. To implement EBA, investigators need high-quality assessment tools along with evidence-based processes. We…

Researchers use many different metrics for evaluation of performance of student models. The aim of this paper is to provide an overview of commonly used metrics, to discuss properties, advantages, and disadvantages of different metrics, to summarize current practice in educational data mining, and to provide guidance for evaluation of student…

In light of the emergence of statistical analysis techniques based on data mining in education sciences, and the potential they offer to detect non-trivial information in large databases, this paper presents a procedure used to detect factors linked to academic achievement in large-scale assessments. The study is based on a non-experimental,…

Whilst professional development (PD) is an activity required by many regulatory authorities, the value that enterprises obtain from PD is often unknown, particularly when it involves development of knowledge. This paper discusses measurement techniques and processes and provides a review of established evaluation techniques, highlighting…

We present a data-based perspective concerning recent (e.g., 2008) "Maclean's" magazine rankings of Canadian universities, including cluster analysis of the 2008 data. Canadian universities empirically resemble and relate to each other in a manner different from their formal classification and final rank ordering in the…

This article offers new directions in measuring racial isolation in schools. The most widely used measurement approach is to examine the mean on the distribution of school percentage non-White across non-White students (the isolation rate) or the percentage of non-White students in schools with large shares of non-Whites (e.g., 90% or more) at a…

The goal of this article was to outline issues critical to evaluating the literature on incremental benefit of multiple effective treatments used together, vs. a single effective treatment, for childhood ADHD. These issues include: (1) sequencing and dosage of treatments being combined and compared; (2) difficulty drawing valid conclusions about…

Reviews three areas of limitations in the comparative evaluations of early intervention alternatives for disabled children presented in this volume: (1) inaccurate outcomes measures; (2) a misconception of parent training programs as representing true family involvement; (3) and the lack of control over the integrity of treatment given study…

Examines the discussion surrounding the establishment of a reliable transfer rate measure by outlining the major arguments advanced by scholars and researchers in the field. Discusses traditional models of calculating transfer rates, their strengths and weaknesses, and introduces nontraditional transfer rate models. (24 citations) (AJL)

Discusses the difficulty in obtaining transfer rates due to the disagreement over definitions of "transfer." Compares different options to show how manipulating the pool of eligible transfer students influences transfer rates. Describes transfer-ready models for calculating transfer eligibility rate, as well as the Student Right-to-Know formula.…

Deliberations about social policy often center on estimates of harm or benefit generated by different interest groups. Problems in what is measured and how it is measured are illustrated by a discussion of research into sexual abuse and rape. Advocacy research is an unreliable foundation for social policy formation. (SLD)

The Performance Review, Analysis, and Improvement System for Educators (PRAISE) is a formative evaluation instrument designed to improve the performance of school principals. The system appears to be reliable and valid and is flexible enough to accommodate the needs of a variety of schools. Sample items and categories of the instrument include…

This learning module, which is intended for use in in-service training for vocational rehabilitation counselors, reviews the systematic methods available to measure and record client behavior. The first section covers procedures for making necessary calculations and keeping needed records with respect to behavioral events and their duration and…