This article provides a validation framework for research on the development and use of science Learning Progressions (LPs). The framework describes how evidence from various sources can be used to establish an interpretive argument and a validity argument at five stages of LP research--development, scoring, generalisation, extrapolation, and use.…

This article provides a validation framework for research on the development and use of science Learning Progressions (LPs). The framework describes how evidence from various sources can be used to establish an interpretive argument and a validity argument at five stages of LP research--development, scoring, generalisation, extrapolation, and use.…

Despite the call for an argument-based approach to validity over 25 years ago, few examples exist in the published literature. One possible explanation for this outcome is that the complexity of the argument-based approach makes implementation difficult. To counter this claim, we propose that the Assessment Triangle can serve as the overarching…

Kane's paper "Validating the Interpretations and Uses of Test Scores" is the most complete and clearest discussion yet available of the argument-based approach to validation. At its most basic level, validation as formulated by Kane is fundamentally a simply-stated two-step enterprise: (1) specify the claims inherent in a particular interpretation…

According to Kane (2006), the argument-based framework is quite simple and involves two steps. First, specify the proposed interpretations and uses of the scores in some detail. Second, evaluate the overall plausibility of the proposed interpretations and uses. Based on experience gained in developing that validity argument, Chapelle, Enright, and…

The fuzziness of assessing second language speaking performance raises two difficulties in scoring speaking performance: "indistinction between adjacent levels" and "overlap between scales". To address these two problems, this article proposes a new approach, "confidence scoring", to deal with such fuzziness, leading to "confidence" scores between…

The reporting of scores on educational tests is at times misunderstood, misinterpreted, and potentially confusing to examinees and other stakeholders who may need to interpret test scores. In reporting test results to examinees, there is a need for clarity in the message communicated. As pressure rises for students to demonstrate performance at a…

Normal Curve Equivalents (NCEs), a new score system for standardized tests, are used by school districts in reporting results to federal funding agencies. The author uses a quiz format to answer questions on the use of NCE scores. (EGS)

The booklet was designed to help each recipient of the California Achievement Test (CAT) reports to understand the general format of the reports, the abbreviations and symbols used, and the types of scores presented. It was also intended to assist in interpreting CAT results and using these results at each level of the educational process to best…

This book is designed to help mental health professionals acquire the knowledge and skills to use the Cognitive Abilities battery of the Woodcock-Johnson[TM] comprehensive assessment system (WJ III). The WJ III was recently divided into the Cognitive Abilities and the Achievement batteries. The chapters are: (1) "Overview"; (2) "How…

The Career Maturity Inventory was revised in 1995 using previously unpublished longitudinal data for item selection. The new inventory has 25 attitude and 25 competence items, each yielding a score that measures degree of career maturity of conative and cognitive variables, respectively. (SK)

Five of the common misuses of tests are reviewed: (1) acceptance of the test title as an accurate and complete description of the variable being measured (failure to examine the manual and the items carefully to know the specific aspects to be tested can result in misuse through selection of an inappropriate test for a particular purpose or…

This book provides step-by-step guidance on the administration, scoring, and interpretation of the Myers-Briggs Type Indicator[R] (MBTI). The book also contains assessment of the test's strengths and weaknesses, advice on its clinical applications, and several case reports. The chapters are: (1) "Overview"; (2) "How To Administer…

School psychologists were surveyed as to their perceptions and opinions of the fourth edition of the Stanford-Binet Intelligence Scale. Responses were received from 97 of the 200 psychologists surveyed, for a response rate of 48.5%. The survey indicated that the majority of school psychologists need additional training in administering, scoring,…

Modern applications of computerized adaptive testing (CAT) are typically grounded in item response theory (IRT; Lord, 1980). While the IRT foundations of adaptive testing provide a number of approaches to adaptive test scoring that may seem natural and efficient to psychometricians, these approaches may be more demanding for test takers, test…