This article provides a conceptual framework for considering both the theoretical and methodological factors that underpin the successful validation of a competency framework. Drawing on educational assessment literature, this article argues that a valid competency framework relates to an interpretive judgement of the credibility of the claims…

The purpose of this paper is to provide a detailed description of the Monitoring the Future research design, including sampling design, data collection procedures, measurement content, and questionnaire format. This study assesses the changing lifestyles, values, and preferences of American youth on a continuing basis. Each year since 1975, at…

This discussion constructs a survey data quality strategy for institutional researchers in higher education in light of total survey error theory. It starts with describing the characteristics of institutional research and identifying the gaps in literature regarding survey data quality issues in institutional research and then introduces the…

The current review addresses the validity of published meta-analyses in education that determines the credibility and generalizability of study findings using a total of 56 meta-analyses published in education in the 2000s. Our objectives were to evaluate the current meta-analytic practices in education, identify methodological strengths and…

Over 99 percent of business schools use student evaluation of instruction to measure teaching and classroom performance. The resultant measures are utilized in judgments of merit pay, tenure, and promotion. In such an environment, an inspection of exceptions to their assumed validity is justified. This paper investigates one such issue that is…

This paper intends to construct a survey data quality strategy for institutional researchers in higher education in light of total survey error theory. It starts with describing the characteristics of institutional research and identifying the gaps in literature regarding survey data quality issues in institutional research. Then it is followed by…

As a result of the generally low quality of child care in the United States and the increased emphasis on accountability in education policy, quality rating systems (QRSs) are proliferating in the child-care arena. QRSs assess child-care providers on multiple dimensions of quality and integrate these assessments into an easily understood summary…

The purpose of this study was to determine the validity of school and district dropout data and, if possible, to establish an accurate dropout rate for the Dade County Public Schools. Several key school files and documents were examined; prior dropout data were examined; and a survey of school personnel was conducted. The general conclusion of the…

This report presents findings from two investigations of the use of classroom artifacts to measure the presence of reform-oriented teaching practices in middle-school science classes. It complements previous research on the use of artifacts to describe reform-oriented teaching practices in mathematics. In both studies, ratings based on collections…

This paper provides a progress report on an investigation to validate and extend the autocatalytic model for the adoption of educational innovations. Three topics are dealt with: (1) a brief description is provided of the autocatalytic model and its current application, (2) the design of a survey to collect data for further tests of the model is…

The 1988 National Survey of Postsecondary Faculty (NSOPF-88), later named the National Study of Postsecondary Faculty, was the first comprehensive study of higher education instructional faculty conducted by the National Center for Education Statistics since 1963. This report provides a description of the 1993 NSOPF and the data generated by its…

No issue in schools and communities today commands the concern and urgency of the U.S. public as much as the dangers of alcohol and other drug (AOD) use among youth. This guide therefore provides descriptive information on the variety of surveys of student alcohol and other drug use currently available, and delineates the issues involved in…

This study determined the effects of two data collection techniques on response rate, response bias, response validity and respondent evaluation. Administration of a computer survey was compared to a machine readable paper survey. Cover letters were sent to 249 college sophomores who were randomly selected and proportionally stratified by intended…

This report summarizes results from research aimed at improving the quality of information collected about school curriculum. The research sought to design and pilot a model for collecting benchmark data on school coursework. These more indepth data, such as course textbooks, assignments, exams, and teacher logs, can serve as anchors against which…

This paper reports the results from an investigation of a method for systematic development of a procedure for assessing the administrator and instructional leader roles in implementation of an innovative school program. The purpose of the study was to design and field-test a feasible and useful approach to examining the degree of…