In the past decade there has been a lot of attention to the quality of the evidence in experimental psychology and in other social and medical sciences. Some have described the current climate as a 'crisis of confidence'. We focus on a specific question: how can we increase the quality of the data in psychology and cognitive neuroscience…

The Education Insights Center produced a series of reports culminating in recommendations for the structure and governance of a preschool through higher education and into the workforce (known as a P20W data system). This brief follows up on that series, with a focus on data quality; the brief was informed by the author's experience using…

In several subdomains of the social, behavioral, health, and human sciences, research questions are increasingly answered through mixed methods studies, combining qualitative and quantitative evidence and research elements. Accordingly, the importance of including those primary mixed methods research articles in systematic reviews grows. It is…

This paper intends to construct a survey data quality strategy for institutional researchers in higher education in light of total survey error theory. It starts with describing the characteristics of institutional research and identifying the gaps in literature regarding survey data quality issues in institutional research. Then it is followed by…

This article examines an external evaluation of the quality assurance system at the Norwegian University of Science and Technology (NTNU) conducted by The Norwegian Agency for Quality Assurance in Higher Education (NOKUT). The external audit report along with internal reports provided by the seven faculties of the university served as the major…

Within the fields of human performance technology (HPT), human resources management (HRM), and management in general, performance measurement is not only foundational but considered necessary at all phases in the process of HPT. In HPT in particular, there is substantial advice literature on what measurement is, why it is essential, and (at a…

This article presents the findings of a survey, conducted on league tables and rankings systems worldwide, including seventeen standard ones and one non-standard league table. Despite the capacity of existing league tables and rankings to meet the interest of the public of transparency and information on higher education institutions, ranking…

Five papers on outcomes assessment and management in health care services are presented. The papers illustrate the different stages of outcomes assessment, including identification and selection of indicators, monitoring and pooling of data, description of variations and identification of problems, analysis of variations, and feedback and results.…

The overall purpose of the national Head Start evaluation is to assess the impact, on the children and parents being served, of: (1) the educational services component of Head Start, and (2) a new demonstration program within Head Start, Basic Educational Skills (BES). The evaluation deals with a total of 65 Head Start programs and their families.…

As the principles and practices of quality assurance are further implanted in higher education, methodological questions about how to understand and manage quality become increasingly important. This paper argues that quality assurance determinations need to take account of how and to what extent students engage with activities that are likely to…

The Task Force on Quality Control of the National Center for Education Statistics (NCES) was created to study the quality control procedures used for NCES publications and to determine if there are ways to improve the current procedures. Because a detailed review of the entire survey process would have been too time consuming, the Task Force…

Disorder and linearity are essential to science, but empirically derived laws indicate that counts do reflect underlying structure and can support inference. Starting from the premise that a linear structure underlies data, G. Rasch deduced that the necessary and sufficient mechanism to convert from counts to linear measures is the logistic ogive.…

The base-year survey of the National Education Longitudinal Study of 1988 (NELS:88) took place in spring 1988. Data on a variety of topics were obtained by questionnaires and achievement tests administered to a national probability sample of 25,000 eighth-graders. This report presents results of an examination of the quality of responses of…

Building on previous discussions of Federal information inventory locator systems (FILS), this report explores issues related to FILS and identifies policy and implementation options that can best meet the competing rationales and requirements for FILS. The concept of a Government-wide Information Inventory/Locator System is explored, and it is…

At the request of the Oklahoma Department of Education, the Technical Assistance Center 3 West conducted a statewide review of local Chapter 1 evaluation data to provide possible explanations for the unusual standardized test score gains or losses reported by a number of local school districts. During the two months of quality control visits, 35…