ACT requested assistance from the National Center for the Improvement of Educational Assessment (Center for Assessment) to investigate declines of scores for states administering the ACT to its 11th grade students in 2018. This request emerged from conversations among state leaders, the Center for Assessment, and ACT in trying to understand the…

The use of video has become well established in education, from traditional courses to blended and online courses. It has grown both in its diversity of applications as well as its content. Such educational video however is not fully accessible to all students, particularly those who require additional visual support or students studying in a…

An old issue in psychological assessment is to what extent power and speed each are measured by a given intelligence test. Starting from accuracy and response time data, an approach based on posterior time limits (cut-offs of recorded response time) leads to three kinds of recoded data: time data (whether or not the response precedes the cut-off),…

As a construct definition, the current study develops a cognitive model describing the knowledge, skills, and abilities measured by critical reading test items on a high-stakes assessment used for selection decisions in the United States. Additionally, in order to establish generalizability of the construct meaning to other similarly structured…

In operational testing programs using item response theory (IRT), item parameter invariance is threatened when an item appears in a different location on the live test than it did when it was field tested. This study utilizes data from a large state's assessments to model change in Rasch item difficulty (RID) as a function of item position change,…

Spearman's factor-analytic model has been proposed as a unidimensional linear item response theory (IRT) model for continuous item responses. This article first proposes a reexpression of the model that leads to a form similar to that of standard IRT models for binary responses and discusses the item indices of difficulty discrimination and…

The Tactual Profile assesses tactual functioning of children with severe visual impairments between 0 and 16 years of age. The Tactual Profile consists of 430 items, measuring tactile skills required for performing everyday tasks at home and in school. Items are graded according to age level and divided into three domains: tactual sensory, tactual…

When a test is adapted from a source language (SL) into a target language (TL), the two forms are usually not psychometrically equivalent. If linking between test forms is necessary, those items that have had their psychometric characteristics altered by the translation (differential item functioning [DIF] items) should be eliminated from the…

This study describes the psychometric evaluation of Super's Work Values Inventory--Revised (SWVI-R), an instrument comprised of 12 scales measuring the relative importance placed on the following work-related value dimensions: Achievement, Coworkers, Creativity, Income, Independence, Lifestyle, Mental Challenge, Prestige, Security, Supervision,…

Properties of dichotomous Guttman-scalable items are described. Both the elements and eigenvalues of the Pearson correlation matrix of such items can be expressed as simple functions of the number of items if the score distribution is uniform and there is an equal number of items at each difficulty level. (SLD)

The aim of this study was to evaluate the effect of aging on the storage of visual and spatial working memory according to Logie's model of working memory (1995). In a first experiment young, elderly, and very old subjects carried out two tasks usually used to measure visual span (Visual Patterns Test) and spatial span (Corsi Block Tapping test).…

Psychometric issues arising from the use of minimum competency tests in local option states were examined in seven school districts. The effect of variability in reliability and difficulty level of subtests on the accuracy of decisions based on such tests is questioned, particularly as they affect mildly handicapped and marginal students.…

This paper discusses the use of two theories of item analysis and test construction, their strengths and weaknesses, and applications to the design of the Hawaii State Test of Essential Competencies (HSTEC). Traditional analyses of the data collected from the HSTEC field test were viewed from the perspectives of item difficulty levels and item…

The Beck Depression Inventory (BDI) is one of the most frequently used instruments in the study of depression both within and outside of the United States. Though developed primarily with European American clinical populations, the BDI has been applied in nonclinical and non-Western samples. To determine whether such a practice is warranted, the…

Modern applications of computerized adaptive testing (CAT) are typically grounded in item response theory (IRT; Lord, 1980). While the IRT foundations of adaptive testing provide a number of approaches to adaptive test scoring that may seem natural and efficient to psychometricians, these approaches may be more demanding for test takers, test…