Postsecondary institutions, and particularly community colleges, are positioned well to train more and more of the nation's entry- and middle-skill workers. The New World of Work (NWoW), a program that promoted teaching and learning soft skills, was designed in 2012 and operated briefly in over 75 community colleges in California. The program…

Rigorous evaluation of social and emotional learning programs requires the use of measures that provide reliable and valid information on the meaningful differences in children's social emotional skills across treatment and control groups, as well as changes over time. In contexts affected by conflict and crisis, few measures can provide the…

This brief provides tips for forming a team of staff and consultants with the needed expertise to make key measurement decisions that will ensure high-quality data for answering the study's research questions. The brief outlines the main responsibilities of measurement team members. It also describes typical measurement tasks and discusses…

Action Research on Measuring Literacy Programme Participants' Learning Outcomes (RAMAA) aims to develop, implement and collaborate on the creation of a methodological approach to measure acquired learning and study the various factors that influence its development. This report examines how RAMAA I has been implemented over the past four years in…

In this commentary, we examine Braverman's insights into the trade-offs between feasibility and rigor in evaluation measures and reject his assessment of the trade-off as a zero-sum game. We, argue that feasibility and policy salience are, like reliability and validity, intrinsic to the definition of a good measure. To reduce the tension between…

High quality measurements are important to evaluate interventions. The study reports on the development of a measurement to investigate authoritative teaching understood as a two-dimensional construct of warmth and control. Through the application of confirmatory factor analysis (CFA) and structural equation modelling (SEM) the factor structure…

Environmental field days offer a distinct opportunity to connect students with science and the environment. The literature on field days, informed by research on field trips, provides a framework for best practices. If there are best practices, however, then presence or lack of the practice should have a discernible impact on the outcomes of the…

This special series focused on treatment integrity in the child mental health and education field is timely. The articles do a laudable job of reviewing (a) the current status of treatment integrity research and measurement, (b) existing conceptual models of treatment integrity, and (c) the limitations of prior research. Overall, this thoughtful…

Documenting treatment integrity is an important issue in research and practice in any discipline concerned with prevention and intervention. However, consensus concerning the dimensions of treatment integrity and how they should be measured has yet to emerge. Advances from three areas in which significant treatment integrity work has taken…

The concept of treatment integrity cuts across a diversity of fields involved with providing treatments or interventions to individuals. In medical treatments, the concept of "treatment compliance" or "treatment adherence" is an important and problematic issue. In the field of nutrition, the concept of "dietary adherence" is important for…

Introduces the practitioner to psychometric issues related to developmental assessment and makes recommendations for the assessment refinements needed in the field. (Author/BH)

This study evaluated the validity, reliability, and utility of five of the six subtests of Clay's (2002) Observation Survey of Early Literacy Achievement (OS), including Letter Identification, Word Reading, Writing Vocabulary, Hearing and Recording Sounds in Words, and Text Reading. In addition to a review of studies providing assessment of the…

This report, prepared by the Delinquency and School Environments Program, describes further interim results of the program's national evaluation of the Alternative Education Program of the Office of Juvenile Justice and Delinquency Prevention (OJJDP). The report is directed primarily to project implementers and to the OJJDP and is organized in two…

Potential methods are explored for removing or otherwise controlling random measurement error, assessment artifacts, irrelevant variation in outcome measures, and confounding sources of covariation in a structural equations model. Using examples with measures of quality of life and functioning, the authors consider these methods for field…

This paper highlights some special characteristics of criterion-referenced tests while comparing them with norm-referenced tests. Psychometric considerations involved in constructing a criterion-referenced test, including item analysis, reliability, and validity, are discussed, along with application of criterion-referenced testing to individual…