This article provides a conceptual framework for considering both the theoretical and methodological factors that underpin the successful validation of a competency framework. Drawing on educational assessment literature, this article argues that a valid competency framework relates to an interpretive judgement of the credibility of the claims…

K-12 Engineering Education has placed a lot of attention on students' attitudes or predispositions towards science and technology. However, most assessment methods are focused on STEM as a whole or only on technology. In this article, we will discuss the instrument called Technology and Engineering Attitude Scale (TEAS) which focuses on attitudes…

Digital literacy is essential for scientific literacy in a digital world. Although the NGSS Practices include many activities that require digital literacy, most studies have examined digital literacy from a generic perspective rather than a curricular context. This study aimed to develop a self-report tool to measure elements of digital literacy…

In a world of burgeoning societal issues, future scientists must be equipped to work interdisciplinarily to address real-world problems. To train undergraduate students toward this end, practitioners must also have quality assessment tools to measure students' ability to think within an interdisciplinary system. There is, however, a dearth of…

The evidence base for school-based consultation practice and training is limited by a small number of studies, possibly due to unique challenges in researching consultation. For example, there are myriad variables to measure and idiosyncratic cultural and contextual factors to account for when investigating what works, for whom, and in what…

The purpose of this paper is to provide a detailed description of the Monitoring the Future research design, including sampling design, data collection procedures, measurement content, and questionnaire format. This study assesses the changing lifestyles, values, and preferences of American youth on a continuing basis. Each year since 1975, at…

This discussion constructs a survey data quality strategy for institutional researchers in higher education in light of total survey error theory. It starts with describing the characteristics of institutional research and identifying the gaps in literature regarding survey data quality issues in institutional research and then introduces the…

The current review addresses the validity of published meta-analyses in education that determines the credibility and generalizability of study findings using a total of 56 meta-analyses published in education in the 2000s. Our objectives were to evaluate the current meta-analytic practices in education, identify methodological strengths and…

Over 99 percent of business schools use student evaluation of instruction to measure teaching and classroom performance. The resultant measures are utilized in judgments of merit pay, tenure, and promotion. In such an environment, an inspection of exceptions to their assumed validity is justified. This paper investigates one such issue that is…

This paper intends to construct a survey data quality strategy for institutional researchers in higher education in light of total survey error theory. It starts with describing the characteristics of institutional research and identifying the gaps in literature regarding survey data quality issues in institutional research. Then it is followed by…

As a result of the generally low quality of child care in the United States and the increased emphasis on accountability in education policy, quality rating systems (QRSs) are proliferating in the child-care arena. QRSs assess child-care providers on multiple dimensions of quality and integrate these assessments into an easily understood summary…

The Organisation for Economic Cooperation and Development's (OECD's) Programme for International Student Assessment (PISA) surveys, which take place every three years, have been designed to collect information about 15-year-old students in participating countries. PISA examines how well students are prepared to meet the challenges of the future,…

The purpose of this study was to determine the validity of school and district dropout data and, if possible, to establish an accurate dropout rate for the Dade County Public Schools. Several key school files and documents were examined; prior dropout data were examined; and a survey of school personnel was conducted. The general conclusion of the…

This report presents findings from two investigations of the use of classroom artifacts to measure the presence of reform-oriented teaching practices in middle-school science classes. It complements previous research on the use of artifacts to describe reform-oriented teaching practices in mathematics. In both studies, ratings based on collections…

This paper provides a progress report on an investigation to validate and extend the autocatalytic model for the adoption of educational innovations. Three topics are dealt with: (1) a brief description is provided of the autocatalytic model and its current application, (2) the design of a survey to collect data for further tests of the model is…