The literature on issues of the reliability and validity of objective and performance assessments in vocational education and training was reviewed and synthesized to develop guidelines for procedures to enhance reliability and validity. The review established the following facts: (1) validity is determined largely through inferences made by both…

Some of the issues faced by institutions as they attempt to design a system of constructs that reflects the diversity of their schools are addressed. The choice of statistic, percentage passing versus mean, used in reporting test results can impact the allocation of services to subpopulations in the school. Percent passing statistics tend to focus…

This paper provides an overview of common sampling methods (both the good and the bad) likely to be used in community college self-evaluations and presents the results from several simulated trials. The report begins by reviewing various survey techniques, discussing the negative and positive aspects of each method. The increased accuracy and…

Procedures for establishing the cutoff scores for the occupational competency exams administered to individuals graduating from Pennsylvania vocational teacher education programs were reviewed. A total of 595 National Occupational Competency Testing Institute (NOCTI) Exams administered in 43 occupations or trades at three colleges between the…

This report describes the growth in cognitive skills and achievement, and the continuities and discontinuities experienced in school and at home by the eighth-grade cohort of the National Education Longitudinal Study of 1988 (NELS:88) during the 2 years between the study's base year (1988) and the first-followup (1990) surveys. The report examines…

Three approaches to the construction of achievement tests are compared: construct, operational, and empirical. The construct approach is based upon classical test theory and measures an abstract representation of the instructional objectives. The operational approach specifies instructional intent through instructional objectives, facet design,…

This study assessed the factor structure of the LanguEdge™ test and the invariance of its factors across language groups. Confirmatory factor analyses of individual tasks and subsets of items in the four sections of the test, Listening, Reading, Speaking, and Writing, was carried out for Arabic-, Chinese-, and Spanish-speaking test takers. Two…

The National Education Longitudinal Study of 1988 (NELS:88) is a large-scale, national longitudinal study designed and sponsored by the National Center for Education Statistics (NCES), with support from other government agencies. Beginning in the spring of 1988 with a cohort of eighth graders (25,000) attending public and private schools across…

Value-added modeling (VAM) to estimate school and teacher effects is currently of considerable interest to researchers and policymakers. Recent reports suggest that VAM demonstrates the importance of teachers as a source of variance in student outcomes. Policymakers see VAM as a possible component of education reform through improved teacher…

This study examines the gaps related to gender and race/ethnicity in entrance, persistence, and attainment of postsecondary science and engineering (S&E) education. After reviewing selected prior research and examining potentially relevant variables in two National Center for Education Statistics (NCES) surveys, several variables were selected…