As frequent consumers and disseminators of research, school psychologists have an ethical obligation to critically evaluate the findings of studies (National Association of School Psychologists, 2010); however, this can feel burdensome when studies are behind paywalls and require hours to properly scrutinize. Particularly when studies utilizing…

The calls for accountability in higher education have made outcome-based assessment a key accreditation component. Accreditation remains a well-regarded seal of approval on college quality, and requires the programme to set clear, appropriate, and measurable goals and courses to attain them. Furthermore, programmes must demonstrate that…

To date, small sample problems with latent growth models (LGMs) have not received the amount of attention in the literature as related mixed-effect models (MEMs). Although many models can be interchangeably framed as a LGM or a MEM, LGMs uniquely provide criteria to assess global data-model fit. However, previous studies have demonstrated poor…

A multi-disciplinary academic unit at a Canadian university completed an evaluation of course syllabi used in its undergraduate programmes over the previous five years. This paper examines the reasons for the evaluation, the processes employed to collect and analyse the data, and how the results will be incorporated into the next steps of the…

This work asks one simple question: "how reliable is the method used by the National Centre for Vocational Education Research (NCVER) to estimate projected rates of VET program completion?" In other words, how well do early projections align with actual completion rates some years later? Completion rates are simple to calculate with a…

In 1916 Robert Frost published his famous poem, "The Road Not Taken," in which he muses about what might have been had he chosen a different path, made a different choice. While counterfactual arguments in general can often lead to vacuous nowheres, frequently in statistics the data that are not presented actually exist, in a sense,…

Owing to the increasing diversity of assessments in higher education, feedback should be provided to students in a format that can assist future and alternative work. This study aimed to assess the effectiveness of the Essay Feedback Checklist on future alternative assessments. Participants were assigned to one of two groups, one of which…

Researchers use many different metrics for evaluation of performance of student models. The aim of this paper is to provide an overview of commonly used metrics, to discuss properties, advantages, and disadvantages of different metrics, to summarize current practice in educational data mining, and to provide guidance for evaluation of student…

Background: Since the discontinuation of Standard Attainment Tests (SATs) in science at age 11 in England, pupil performance data in science reported to the UK government by each primary school has relied largely on teacher assessment undertaken in the classroom. Purpose: The process by which teachers are making these judgements has been unclear,…

This paper draws on data and experiences observing and analyzing school lotteries from the National Evaluation of Charter School Impacts (Gleason et al., 2010) to describe the challenges associated with lottery-based research. In that study, covering 36 charter middle schools in 15 states, we found that charter schools did not affect student…

Statistical modeling of school effectiveness data was originally motivated by the dissatisfaction with the analysis of (school-leaving) examination results that took no account of the background of the students or regarded each school as an isolated unit of analysis. The application of multilevel analysis was generally regarded as a breakthrough,…

This study provides a database evaluation method for the practicing bibliographer that is more than a brief review yet less than a controlled experiment. The author establishes evaluation criteria in the context of the bibliographic instruction provided to meet the research requirements of undergraduate sociology majors at Queens College, City…

The criteria for determining the student outcomes that define a school as having "turned around" are not well defined, and the definition of turnaround performance varies across studies. Although current policy initiatives offer guidelines for identifying CLP schools, there is no standard definition or methodology in common usage. This…

Ruscio et al. (Ruscio, Seaman, D'Oriano, Stremlo, & Mahalchik, this issue) write of a thing with which scientists and scholars are all too familiar, the assessment of published research and of its authors. The author was startled to discover how little the agenda of the paper seems to engage with factors one relies on for salary and promotion…

This paper describes a model proven to be effective for assessing and documenting evidence of student learning outcomes. Specifically, it will share a model, F.A.M.O.U.S. Copyright ©2008, which is an acronym exemplifying six effective steps for complying with institutional accountability and eternal assessment requirements proscribed by the…