When randomized control trials are not possible, quasi-experimental methods often represent the gold standard. One quasi-experimental method is difference-in-difference (DiD), which compares changes in outcomes before and after treatment across groups to estimate a causal effect. DiD researchers often use fairly exhaustive robustness checks to…

Researchers strategically assess youth mental health by soliciting reports from multiple informants. Typically, these informants (e.g., parents, teachers, youth themselves) vary in the social contexts where they observe youth. Decades of research reveal that the most common data conditions produced with this approach consist of discrepancies…

In 2017, the Office of Planning, Research, and Evaluation (OPRE) in the Administration for Children and Families (ACF) funded Mathematica to conduct the Infant and Toddler Teacher and Caregiver Competencies (ITTCC) project. The project aims to examine existing efforts across states, institutions of higher education, professional organizations, and…

The long-term goal of the State Systemic Improvement Plan (SSIP) and other federal and state early intervention and early childhood education initiatives is improved child and family outcomes. States play a critical role in supporting practitioners in the use of evidence-based practices to improve child and family outcomes. When practitioners…

Standardizing aspects of assessments has long been recognized as a tactic to help make evaluations of examinees fair. It reduces variation in irrelevant aspects of testing procedures that could advantage some examinees and disadvantage others. However, recent attention to making assessment accessible to a more diverse population of students…

Objectives: African American urban adolescents are one of the fastest growing groups of children affected by their mother's HIV status. These children experience HIV stigma by association with their HIV-positive mothers. Stigma may contribute to adverse outcomes for these teens. Methods: The authors describe a multistage process of scale…

This handbook is designed as a quick reference for first-year teachers who find themselves in an assessment driven environment with little experience to help make sense of the language, underlying philosophy, or organizational structure of the assessment system. The handbook begins with advice on developing and evaluating effective learning…

A measure of the usefulness of a pass/fail testing decision procedure is the ratio of the utility of the given procedure to the utility of a procedure based on knowledge of scores on a criterion measure. It is computed from scores for a representative sample of persons tested. Utility functions may be specified by the test user or set by…

This investigation sought to study separately evaluative devices for assessing levels of performance and knowledge competency in basketball, swimming, and gymnastics. Subjects were women students at the University of Washington, 1968-69. For assessment of basketball competence, indications are that: (1) evaluation, by one individual, of films of…

Game-like and test-like methods of divergent thinking assessment were compared with 10-year olds. Effects of method on score correlates were sufficient to allow the possibility that method may be implicated in outcomes of many studies of divergent thinking. (Author)

Discusses authenticity in language testing in relation to the language proficiency movement. Looks at both sociolinguistic and psychometric principles as they are concerned with authenticity and validity as well as the inferential distance that separates face validity from techical validities. Criticizes the belief that some test type possess…

In this interview, Leon Kamin, a prominent psychologist, rejects the theory that intelligence is transmitted by heredity. He deplores the practice of finding scientific data to support political policies, and he challenges that standardized tests-as they are now used-create social harm. (Editor/PG)

This article describes a device used to array the pieces of the Object Assembly Test, a subscale of the Wechsler Intelligence Scales for Children, in exact standardized order in less time than is now needed and without a screen, thus guaranteeing that the subject will have no previous experience with the pieces. (Author/BY)