Survey-based research is vital in education and social sciences, offering insights into human behaviors and perceptions. The prevalence of such studies in medical education has risen by 33% over the past decade. Despite this growth, the utility of survey findings depends on the study design quality and measure validity. Many manuscripts are…

The Distributed Item Review (DIR) is a secure and flexible, web-based system designed to present test items to expert reviewers across a broad geographic area for evaluation of important dimensions of quality (e.g., alignment with standards, bias, sensitivity, and student accessibility). The DIR is comprised of essential features that allow system…

The article serves as a guide for researchers in developing evidence of validity using bivariate correlations, specifically construct validity. The authors outline the steps for calculating and interpreting bivariate correlations. Additionally, they provide an illustrative example and discuss the implications.

In 2017, the Office of Planning, Research, and Evaluation (OPRE) in the Administration for Children and Families (ACF) funded Mathematica to conduct the Infant and Toddler Teacher and Caregiver Competencies (ITTCC) project. The project aims to examine existing efforts across states, institutions of higher education, professional organizations, and…

Assessments come in many forms in part because they serve many purposes, and those purposes often vary by the stakeholders they support. Students, parents, teachers, and school, district and state leaders may all be end users of the information provided by various assessments. This brief supports state leaders' understanding of assessments by…

This report presents a survey tool, developed by REL Central at Marzano Research, designed to gather information from teachers about their perceptions of and responses to evaluator feedback. District or state administrators can use this survey to systematically collect teacher perceptions on five key aspects of evaluation feedback: (1) feedback…

This guide is addressed to policy officials, program providers, and researchers who are seeking to: (1) identify and implement social programs backed by valid evidence of effectiveness; or (2) sponsor or conduct an evaluation to determine whether a program is effective. The guide provides a brief overview of which studies can produce valid…

The purpose of this document is to serve as a reference guide for States involved in the P-20 effort to map data elements to the Common Education Data Standards (CEDS). It describes how one State used Align to assist in development of its P-20 system and describes in detail how this project could be replicated. The CEDS provide a shared vocabulary…

Technology can change higher education by empowering students to make an impact on the world as undergraduates. Done systematically, this would allow institutions to close the credibility gap with an increasingly dubious public. Authentic student achievements that are addressed to a "real world" audience can lead to richly detailed…

For children age birth to five, physical, cognitive, linguistic, and social-emotional growth and development occur at a rapid pace. While all children in this age range may not reach developmental milestones (e.g., smiling, saying first words, taking first steps) at the same time, development that does not happen within an expected timeframe can…

Everyone who runs a youth program believes in their hearts that their program helps kids, but in their heads, they know they need convincing data to prove it. This guide--updated from 2011--is here to help them get the data they need. The guide addresses a common problem throughout the youth field: Out-of-school time (OST) programs can help youth…

This issue of "FOCUS" discusses external validity and what rehabilitation researchers can do to help practitioners answer the question "How far can we generalize this finding-- is it applicable to other clients/patients, with different characteristics, in dissimilar settings treated by other clinicians?," which clinicians and…

States and districts across the country are grappling with how to incorporate assessments of student learning into their teacher evaluation systems. Sophisticated statistical models have been proposed to estimate the relative value individual teachers add to their students' assessment performance (hence the term teacher "value-added" measures).…

States and districts across the country are grappling with how to incorporate assessments of student learning into their teacher evaluation systems. Sophisticated statistical models have been proposed to estimate the relative value individual teachers add to their students' assessment performance (hence the term teacher "value-added" measures).…

Across the nation, states and districts are in the process of building better teacher evaluation systems that not only identify highly effective teachers but also systematically provide data and feedback that can be used to improve teacher practice. "A Practical Guide to Designing Comprehensive Teacher Evaluation Systems" is a tool…