The present study aimed to represent the innovative assessments that support students' learning in STEM education through using the integrative framework for Cognitive Diagnostic Modeling (CDM). This framework is based on three components, cognition, observation, and interpretation (National Research Council, 2001). Specifically, this dissertation…

In recent years, the social sciences have seen a resurgence in the study of divergent thinking (DT) measures. However, many of these recent advances have focused on abstract, decontextualized DT tasks (e.g., list as many things as you can think of that have wheels). This study provides a new perspective by exploring the reliability and validity…

Much of the argument about comparability of examination standards is at cross-purposes; contradictory positions are in fact often both defensible, but they are using the same words to mean different things. To clarify this, two broad conceptualisations of standards can be identified. One sees the standard in the observed phenomena of performance…

Robert Coe has claimed that three broad conceptions of comparability can be identified from the literature: performance, statistical and conventional. Each of these he rejected, in favour of a single, integrated conception which relies upon the notion of a "linking construct" and which he termed "construct comparability".…

In this paper, a new item analysis index, e, is derived as a function of difficulty and discrimination to represent item efficiency. Item discrimination in this paper is not independent of item difficulty, and it is demonstrated algebraically that the maximum discriminating power of an item may be determined from its difficulty. Item efficiency is…

Three procedures that help to determine the degree of confidence we can place in any raw score are discussed: computing the standard error of measurement, computing the estimated true score, and constructing confidence intervals. These three procedures are easy to use and require only elementary mathematical skills. (Author/CL)

In this paper it is argued that the problem of construct validation in the construction of instruments and indicators is an important problem for educational researchers and practitioners; moreover, it is claimed that the popular notion of operational definition is a misleading idea which has obscured the problem of construct validity in…

Measurement terms used in Title I evaluation are contained in this glossary. Several types of measurement techniques are identified and defined. Other measurement terms which are defined include those relating to validity, reliability, statistical analysis, test interpretation, and program effectiveness. (DWH)

An approach to partitioning the variance in student ratings not previously reported in the literature is described. The new approach provides an alternative basis for interpreting faculty evaluations that overcome objections to current practices. Student responses on evaluation forms were cluster-analyzed to establish homogeneous subgroups of…

Some basic statistical concepts relevant to the teacher--mean scores, standard deviation, normal and skewed distributions, z scores, item analysis, standard error of measurement, reliability--and their use by the teacher are explained. (RM)

The path from a collection of observations and measurements to a set of warranted conclusions is fraught with hazards. This chapter describes the path and offers some guidance on how to negotiate it. It also discusses presenting results in a way that can be understood by nontechnically trained persons. It should enable the reader to better…

Principal components analysis of standardization sample data for the Comprehensive Test of Adaptive Behavior, involving 6,647 persons with mental retardation, found that a single factor accounted for 86 percent of the variance in category scores. Use of the Total Score and idiographic item clusters is psychometrically preferable to use of category…

A technique for displaying and analyzing Osgood's Semantic Differential data in three -dimensional semantic space is described. The technique employs a square board, with equidistant drilled holes, in which are placed dowels of various lengths combined with labels of different shapes. Studies have found 3 major factors (Evaluation, Activity, and…