This report describes the process of developing and validating the enhanced ACT. The report describes the changes made to the test content and the processes by which these design decisions were implemented. The authors describe how they shared the overall scope of the enhancements, including the initial blueprints, with external expert panels,…

Comparative accuracy studies evaluate the relative performance of two or more diagnostic tests. As any other form of research, such studies should be reported in an informative manner, to allow replication and to be useful for decision-making. In this study we aimed to assess whether and how components of test comparisons were reported in…

Background: Engineers operate in an increasingly global environment, making it important that engineering students develop global engineering competency to prepare them for success in the workplace. To understand this learning, we need assessment approaches that go beyond traditional self-report surveys. A previous study (Jesiek et al.,…

The calibration of test materials generally involves the interaction between empirical analysis and expert judgement. This paper explores the extent to which scale familiarity might affect expert judgement as a component of test validation in the calibration process. It forms part of a larger study that investigates the alignment of the…

Abilities in scientific thinking and reasoning have been emphasized as core areas of initiatives, such as the Next Generation Science Standards or the College Board Standards for College Success in Science, which focus on the skills the future will demand of today's students. Although there is rich literature on studies of how these abilities…

The past decade has seen an emerging interest in mapping (aligning or linking) test scores to language proficiency levels of external performance scales or frameworks, such as the Common European Framework of Reference (CEFR), as well as locally developed frameworks, such as China's Standards of English Language Ability (CSE). Such alignment is…

Objective: Frontline health professionals need a "red flag" tool to aid their decision making about whether to make a referral for a full diagnostic assessment for an autism spectrum condition (ASC) in children and adults. The aim was to identify 10 items on the Autism Spectrum Quotient (AQ) (Adult, Adolescent, and Child versions) and on…

Compares direct and indirect writing assessment strategies and contrasts them in terms of the relationship each has to specific classroom decision-making situations, the components of writing assessed, practical testing matters, characteristics of test exercises, test scoring procedures, and procedures for determining test quality. (HOD)

Existing item response data on three achievement tests were used to compare the use of two sequential testing procedures with conventional testing for purposes of dichotomous decisions on each of the three dimensions. (Author/AG)

Compares and factor analyzes the Career Decision Scale and Vocational Decision-Making Difficulty Scale. Subjects included undergraduates who were satisfied with their career choices and those who were unsure, dissatisfied, or undecided about theirs. Both scales seem promising. (CKJ)

This study attempted to establish the validity of an essay test of clinical judgment by defining the domain of clinical judgment and operationalizing this definition in a 12-item essay examination administered to 98 residents in internal medicine. The relationship between essay scores and other measures of competence was then examined and the…

The purpose of this study was to provide test-retest reliability data for Holland's Self Directed Search for Educational and Vocational Planning (SDS). Sixty-five subjects were administered the SDS 7-10 months after they completed it during freshman orientation. Results indicated little change in summary codes obtained by subjects. Median…

Preliminary use of the Self Directed Search (SDS) led to the speculation that some people were very dissatisfied with their results and others were quite pleased. Of the 4,631 incoming freshmen at the University of Maryland who completed the SDS, 485 were extremely dissatisfied with their results. The codes for these groups were compared using…

This paper discusses the use of assessment instruments at the preschool level and systematically reviews several measurement instruments used with young children. The first section briefly discusses the selection of educational objectives, consideration of alternative methods of collecting information about children, the selection of a specific…

The existence of criterion-referenced (CR) measurement is questioned in this paper. Despite beliefs that differences exist between two alternative forms of measurement, CR and Norm Referenced (NR), an analysis of philosophical and psychological descriptions of measurement, as well as a growing number of empirical studies, reveal that the common…