Across the world, teacher quality has come to be recognised as one of the most important variables affecting student outcomes; consequently, the regulation of entry into the profession is the subject of iterative review. The traditional 'one-off' interview, involving an interviewee and two or more interviewers, is a common, but not unproblematic,…

Those asked to make valid decisions with data don't have the technical knowledge to understand nuance around data quality, assessment aims, and statistical limitations that influence how they should interpret the data. This reality is what Greg Thompson, Leslie Rutkowski, and David Rutkowski call the validity paradox. Educators can surmount this…

This article builds upon a proiminent definition of construct validity that focuses on variation in attributes causing variation in measurement outcomes. This article synthesizes the defintion and uses Rasch measurement modeling to explicate a modified conceptualization of construct validity for assessments of developmental attributes. If…

Participatory modeling (PM) is an engaged research methodology for creating analog or computer-based models of complex systems, such as socio-environmental systems. Used across a range of fields, PM centers stakeholder knowledge and participation to create more internally valid models that can inform policy and increase engagement and trust…

In recent years, academic return on investment (A-ROI) has gained growing attention from policy makers as well as education practitioners and stakeholders as a tool to drive how limited financial resources are used to improve student achievement. In this series, we discuss five basic issues around using A-ROI for informing and improving resource…

In standardized educational testing, test items are reused in multiple test administrations. To ensure the validity of test scores, the psychometric properties of items should remain unchanged over time. In this article, we consider the sequential monitoring of test items, in particular, the detection of abrupt changes to their psychometric…

Peer-mediation in a school environment, when carried out correctly, can benefit not only the parties of the conflict, but also their environment, including the school, the team, the family and the mediator. A serious same has been designed and a prototype developed for the training of minors and young adults as mediators. The core of the game is a…

Evidence-based assessment (EBA) requires that investigators employ scientific theories and research findings to guide decisions about what domains to measure, how and when to measure them, and how to make decisions and interpret results. To implement EBA, investigators need high-quality assessment tools along with evidence-based processes. We…

Published work on vocabulary assessment has grown substantially in the last 10 years, but it is still somewhat outside the mainstream of the field. There has been a recent call for those developing vocabulary tests to apply professional standards to their work, especially in validating their instruments for specified purposes before releasing them…

Increasingly content area projects and programs at the K-12 level, such as in mathematics, involve a programmatic component or project emphasis on developing "teacher leadership". However, there is no consistent definition or framework for this construct and even fewer validated tools for measuring it. This paper describes our efforts in…

This article examines the concept of credible evidence in Extension evaluations with specific attention to the measures and measurement strategies used to collect and create data. Credibility depends on multiple factors, including data quality and methodological rigor, characteristics of the stakeholder audience, stakeholder beliefs about the…

There is a legitimate need for data on the performance of higher education institutions. It is important for the institutions themselves, as well as their stakeholders, including society. The use of indicators that measure the effectiveness or quality of education is increasing as there is much demand for more evidence-based evaluation and…

Exploratory factor analysis (EFA) is a data reduction technique used to condense data into smaller sets of summary variables by identifying underlying factors potentially accounting for patterns of collinearity among said variables. Using an illustrative example, the 5 general steps of EFA are described with best practices for decision making…

While college readiness continues to dominate the educational landscape in the United States, students still leave high school not ready for college. As a consequence, admissions officers need to consider all available indicators (e.g., high school performance, admissions test scores, college preparatory courses) in order to effectively evaluate…

Standard setting is the process of identifying the point(s) on a scale that serve to differentiate between individuals of distinct proficiency levels. While standard setting is ultimately a policy decision, most of the process is carried out by subject matter experts who are tasked with reconciling item-level or examinee-level information (e.g.…