The vast majority of measures have, at their core, a purpose of personal and social change. If test developers and users want measures to have personal and social consequences and impact, then it is critical to consider the consequences and side effects of measurement in the validation process itself. The consequential basis of test interpretation…

Educational assessment and, more broadly, educational research in the United States have entered into an era characterized by a dramatic increase in the prevalence and importance of test score use in accountability systems. This volume covers a selection of contemporary issues about testing science and practice that impact the nation's public…

The factorial validity and reliability of the Maslach Burnout Inventory (MBI) (C. Maslach and S. Jackson, 1982) for use with coaching populations at educational institutions was investigated. A sample of 199 college basketball coaches served as subjects for the study. The coaches completed a demographic data sheet and a modified version of the…

Statistical and theoretical issues that arise from assessing person-fit on measures of typical performance are discussed, including the frequent attenuation of detection of person-misfit, the need for methods of identifying sources of response aberrancy, and person-fit measures as moderators of trait-criterion relations. (SLD)

The purpose of this paper is to demonstrate how graphical analyses can enhance the interpretation and understanding of multidimensional item-response theory (IRT) analyses. Conceptually many of the unidimensional IRT concepts such as item characteristic curves, information, etc., can be extended to multiple dimensions. However, as the…

This study was conducted to evaluate whether the adjectival self-description checklist may provide a viable method of quickly obtaining initial personality type information. The Personal Preferences Self-Description Questionnaire (PPDSQ) was administered to more than 420 college students, and data were analyzed using classical reliability analysis…

A growing number of states are using annual school-level test scores as part of their school accountability systems. This paper highlights an under-appreciated weakness of that approach, the imprecision of school-level test score means, and proposes a method for discerning signal from noise in annual school report cards. Using methods developed in…

We examine the equivalence of two construct-a-concept-map techniques: construct-a-map with created linking phrases (C), and construct-a-map with selected linking phrases (S). The former places few constraints on the respondent and has been considered the gold standard; the latter is cost and time efficient. Both their products and processes are…

The Myers-Briggs Type Indicator (MBTI) is one of the most frequently used measures of personality. MBTI Form G and a self-descriptive adjectival checklist, the "Personal Preferences Self-Description Questionnaire" (PPSDQ), were administered to 191 college students. The four dimensions of personality measured by the MBTI are:…

Cognitive processes in the Raven Progressive Matrices Test, a nonverbal test of analytic intelligence, are analyzed in terms of processes distinguishing between high- and low-scoring students and processes common to all subjects and test items. Two experiments with 89 college students identify the abilities distinguishing among individuals. (SLD)

The nature of percentile ranks scores is explored using concrete heuristic examples. It is explained why arithmetic operations require measurement on equal-interval scales, and that percentile ranks are not measured on equal-interval scales and therefore may not be added or averaged. The consequences of inappropriately adding percentile ranks are…

Data from the areas of job satisfaction and job stress are used to illustrate the following points: (1) that measurements can be arranged conceptually along a continuum from the specific to the global (or general); (2) that scales can be constructed which represent different levels of generality, within the same content area; (3) that such scales…

A study investigated the utility of a measure for assessing the writing apprehension of Japanese students of English as a second language. The Daly-Miller questionnaire, designed to measure writing apprehension, was translated into Japanese and administered to 687 first- and second-year students of English at a Japanese junior college. Results…

Issues pertaining to the quality of performance assessments, including reliability and validity, are discussed. The relatively limited generalizability of performance across tasks is indicative of the care needed to evaluate performance assessments. Quality control is an empirical matter when measurement is intended to inform public policy. (SLD)

This package contains articles in three general areas: items covering measurement topics; brief and practical guides on measurement techniques; and professional reading on broader assessment issues. The purpose of these publications by "Set" is to provide research information to teachers. The initial article, "Overview of Issues in…