Purpose: Considering current debates on ecosystem services' effectiveness and the AIS/AKIS functioning, in this study we suggest a new, systemic way to evaluate extension systems (ESs). Using this model, we compared the effectiveness of ESs in three countries with essential differences but also characteristic similarities in their agricultural…

As learning and teaching theory experts, university educators are constantly asked to review and reflect on their methodologies and to co-generate them with all members of the educational community. Teachers understand that students constantly shape the object of study, and thus embrace differences among individuals. In this context, a dialogic…

"The Childhood Autism Rating Scale, Second Edition" (CARS2; 2010) includes two rating scales; the CARS2-Standard Version (CARS2-ST) and the newly developed CARS2-High Functioning Version (CARS2-HF). To assess the diagnostic agreement between the CARS2 and DSM-IV-TR versus DSM-5 criteria for Autism Spectrum Disorder (ASD), clinicians at…

The purpose of this manuscript is to describe a competency-based approach to designing and assessing master's level professional preparation programs in the field of higher education administration. Given the absence of a universal set of competencies defined for HEA master's degree programs, the authors draw from the CAHEP (2010) and Wright…

In this paper, we provide an overview of psychometric procedures and guidelines Educational Testing Service (ETS) uses to evaluate automated essay scoring for operational use. We briefly describe the e-rater system, the procedures and criteria used to evaluate e-rater, implications for a range of potential uses of e-rater, and directions for…

In music education, current assessment trends emphasize student reflection, tracking progress over time, and formative as well as summative measures. This view of assessment requires instrumental music educators to modernize their approaches without interfering with methods that have proven to be successful. To this end, the Longitudinal Scales…

The purpose of this document is to describe the methods RAND used to analyze achievement for 23 personalized learning (PL) schools for the 2012-13 through 2013-14 academic years. This work was performed at the request of the Bill & Melinda Gates Foundation (BMGF), as part of a multi-year evaluation contract. The 23 schools were selected from a…

This article draws on previously employed methods for conducting fidelity studies and applies them to an evaluation of an unprescribed intervention. We document the process of assessing the fidelity of implementation of the Math Recovery first-grade tutoring program, an unprescribed, diagnostic intervention. We describe how we drew on recent…

One of the dilemmas that teachers frequently face is grading student papers. As a teacher, the author regularly reads research regarding instructional practices, grading, and assessment, but struggled to translate theory into practice in her own classroom. The intent of this article is to share one method of instructing and grading writing that…

The test review process used by the Buros Center for Testing is described as a series of 11 steps: (1) identifying tests to be reviewed, (2) obtaining tests and preparing test descriptions, (3) determining whether tests meet review criteria, (4) identifying appropriate reviewers, (5) selecting reviewers, (6) sending instructions and materials to…

This article sets the stage for the description of a variety of approaches to test reviewing worldwide. It describes the importance of test reviewing as a protection of the public and of society and also the benefits of this activity for test users, who must choose measures to use in particular situations with particular clients at a particular…

In joint partnership, Achieve, The Council of Chief State School Officers, and Student Achievement Partners have developed a Toolkit for Evaluating the Alignment of Instructional and Assessment Materials to the Common Core State Standards. The Toolkit is a set of interrelated, freely available instruments for evaluating alignment to the CCSS; each…

In joint partnership, Achieve, The Council of Chief State School Officers, and Student Achievement Partners have developed a Toolkit for Evaluating the Alignment of Instructional and Assessment Materials to the Common Core State Standards (CCSS). The Toolkit is a set of interrelated, freely available instruments for evaluating alignment to the…

This article addresses the leadership preparation line of inquiry developed in the past decade by the University Council for Educational Administration/Learning and Teaching in Educational Leadership Special Interest Group Taskforce on Evaluating Leadership Preparation Programs, and it particularly addresses the series of survey instruments…

In this article, the characteristics of five test review models are described. The five models are the US review system at the Buros Center for Testing, the German Test Review System of the Committee on Tests, the Brazilian System for the Evaluation of Psychological Tests, the European EFPA Review Model, and the Dutch COTAN Evaluation System for…