In the past decade, moderated mediation analysis has been extensively and increasingly employed in social and behavioral sciences. With its widespread use, it is particularly important to ensure the moderated mediation analysis will not bring spurious results. Spurious effects have been studied in both mediation and moderation analysis, but this…

An overview of standards related to demonstrating evidence regarding relationships with criteria as it pertains to instrument development was presented, along with heuristic examples. Additional measures and a comprehensive design are necessary to establish evidence related to the use and interpretation of test scores for the validation of a…

The purpose of this document is to describe the methods RAND used to analyze achievement for 23 personalized learning (PL) schools for the 2012-13 through 2013-14 academic years. This work was performed at the request of the Bill & Melinda Gates Foundation (BMGF), as part of a multi-year evaluation contract. The 23 schools were selected from a…

Sound evaluation planning requires numerous decisions about how constructs in a program theory will be translated into measures and instruments that produce evaluation data. This article, the first in a dialogue exchange, examines how decisions about measurement are (and should be) made, especially in the context of small-scale local program…

Most board of trustees' evaluations of a president's performance look backward, assuming that the challenges of the future will be pretty much the same as they've always been. But as every alert trustee now realizes, colleges and universities face problems more daunting than the familiar conundrums of the past. As a result, each presidential…

Public school teachers in the United States are famously difficult to dismiss. The reason is simple: after three years on the job, most receive tenure--after a brief and subjective evaluation process in which few receive negative ratings. In recent years, some school districts have experimented with changes in tenure rules. They seek the power to…

As some colleges and universities experience low rates of student success, many point to the large number of students who are placed into and fail to complete developmental education courses. Research examining the efficacy of course placement tests has suggested that success rates would increase if students were placed more accurately. A recent…

Alternative approaches are discussed for use of e-rater[R] to score the TOEFL iBT[R] Writing test. These approaches involve alternate criteria. In the 1st approach, the predicted variable is the expected rater score of the examinee's 2 essays. In the 2nd approach, the predicted variable is the expected rater score of 2 essay responses by the…

Over the past year, in a process to select the winner of the Aspen Prize for Community College Excellence, the Aspen Institute has convened national experts to define and determine how to measure "excellence," to identify community colleges with high levels of student success, and to help more community colleges understand what can be done to…

The Partnership for Assessment of Readiness for College and Careers (PARCC) is a consortia of states that is developing a next-generation assessment system in English and math anchored in what it takes to be ready for college and careers. To accomplish this goal the consortia must determine whether individual students are college and career-ready,…

What is meant by text complexity is a measurement of how challenging a particular text is to read. There are a myriad of different ways of explaining what makes text challenging to read, from the sophistication of the vocabulary employed to the length of its sentences to even measurements of how the text as a whole coheres. Research shows that no…

Objective: The current introductory article provides the rationale for the special section on understudied smokers and innovative treatments. This article proposes a definition of "special populations" of smokers, outlines a priori criteria by which to judge whether an intervention should be adapted for these smokers, and delineates a process by…

Learning communities can trace their origins to the 1920s and the experimental College at the University of Wisconsin, but the widespread use of learning communities to improve undergraduate education is a relatively new phenomenon. The early learning communities of the late 1980s and early 1990s consisted of groups of new freshmen co-enrolled in…

This "Practitioner's Guide to Growth Models," commissioned by the Technical Issues in Large-Scale Assessment (TILSA) and Accountability Systems & Reporting (ASR), collaboratives of the "Council of Chief State School Officers," describes different ways to calculate student academic growth and to make judgments about the…

Many campus law enforcement administrators reach a point where they need to request additional staff. Unless the department is awash in extra funding or is in the wake of a major incident that brought significant attention to current manpower, they're likely fighting an uphill battle for growth. The effectiveness of formulas that analyze the size…