Objectives: Discussions of fairness in criminal justice risk assessments typically lack conceptual precision. Rhetoric too often substitutes for careful analysis. In this article, we seek to clarify the trade-offs between different kinds of fairness and between fairness and accuracy. Methods: We draw on the existing literatures in criminology,…

There is currently much controversy in the student evaluations of teaching, employed by many universities world-wide. The administrators see these as a valuable means to measure a teacher's effectiveness and, hence, potential for advancement, while much of the research suggests that these may be unreliable proxies for how effective the student…

As evaluators, we are often asked to determine whether policies and programs provide value for the resources invested. Addressing that question can be a quandary, and, in some cases, evaluators question whether cost-benefit analysis is fit for this purpose. With increased interest globally in social enterprise, impact investing, and social impact…

The article serves as a guide for researchers in developing evidence of validity using bivariate correlations, specifically construct validity. The authors outline the steps for calculating and interpreting bivariate correlations. Additionally, they provide an illustrative example and discuss the implications.

Effective assessment practice requires clearly defining and operationalizing terminology. We illustrate the importance of this practice by focusing on academic "undermatching"--when students enroll in colleges that are less academically selective than those for which they are academically prepared. Undermatching has been viewed as a…

The increasing number of publications on recommender systems for Technology Enhanced Learning (TEL) evidence a growing interest in their development and deployment. In order to support learning, recommender systems for TEL need to consider specific requirements, which differ from the requirements for recommender systems in other domains like…

Self-assessment practices have been advocated in recent Irish educational documents due to their potential to enhance school children's learning and self-regulatory skills. However, the literature has highlighted how some children struggle to make accurate self-assessments of their academic work, which diminishes such positive effects (Keane and…

This article systematically examines differences between student and faculty perspectives on quality instruction, using local data for a regional university's college of business matched to RateMyProfessors.com evaluations. Particular attention is focused on gender bias, "hotness," and "easiness." In addition to documenting a…

Psychometrics has recently undergone extensive criticism within the medical education literature. The use of quantitative measurement using psychometric instruments such as response scales is thought to emphasize a narrow range of relevant learner skills and competencies. Recent reviews and commentaries suggest that a paradigm shift might be…

This article examines a government attempt to impose testing of 4-year-olds as a baseline against which to "hold primary schools accountable" for children's subsequent progress. It examines the various forms of baseline testing in this experiment and analyses the misleading claims made for the "predictive validity" of baseline…

Based on analyses of Maclean's ranking data pertaining to Canadian universities published over the last 24 years, we present a summary of statistical findings of annual ranking exercises, as well as discussion about their current status and the effects upon student welfare. Some illustrative tables are also presented. Using correlational and…

The purpose of this review is to provide an overview of the evolution of social presence research in the field of distance education and identified problems in investigating this construct. The researchers took an integrative review on existing social presence studies to answer three questions: (a) How definitions of social presence evolved since…

This study examines the perceptions of teachers in one Midwest school district relative to the current teacher evaluation system used in the district as well as a new model of teacher evaluation connected to Missouri's educator standards. To fully understand the perspective of the teachers, this study incorporates a mixed-methods approach which…

The literature on bibliometric indices for assessing scholarly impact, in particular the "h" index (Hirsch, 2005) and its many variants, is extensive, but nevertheless Ruscio and colleagues (this issue) succeed in making a valuable contribution. They have made the effort of collecting publication and citation data for no less than 1,750…

When lotteries are infeasible, researchers must rely on observational methods to estimate charter effectiveness at raising student test scores. Considerable attention has been paid to observational studies by the Stanford Center for Research on Education Outcomes (CREDO), which have analyzed charter performance in 27 states. However, the…