Construct validity and building validity arguments are some of the main challenges facing the language assessment community. The notion of construct validity and validity arguments arose from research in psychological assessment and developed into the gold standard of validation/validity research in language assessment. At a theoretical level,…

This study examines the range of cognitive processes assessed in the English language reading literacy test as part of the Hong Kong Diploma of Secondary Education Examination (HKDSE), the secondary school exit test in Hong Kong. Prior studies have suggested that higher order cognitive processes are often undermined in high-stakes tests and…

Providing test questions after an initial study phase is a common instructional technique. In theory, questions that require higher-level (deep) processing should be more beneficial than those that require lower-level (shallow) processing. However, empirical evidence on the matter is inconsistent. To shed light on two potential reasons for these…

Multiple-choice retrieval practice with additional lures reduces retention on a later test (Roediger & Marsh, 2005). However, the mechanism underlying the negative outcomes with additional lures is poorly understood. Given that the positive outcomes of retrieval practice are associated with enhanced relational and item-specific processing…

This study examined students' competencies in engineering education at the university level. First, we developed a competency model in one specific field of engineering: process dynamics and control. Then, the theoretical model was used as a frame to construct test items to measure students' competencies comprehensively. In the empirical…

As a result of the upcoming Federal reauthorization of the Individuals With Disabilities Education Improvement Act (IDEA), practitioners and researchers have begun vigorously debating what constitutes evidence-based assessment for the identification of specific learning disability (SLD). This debate has resulted in strong support for a method that…

This paper considers three areas related to the testing of minimum knowledge and skills: public policy, the nature of higher-order thinking and selected aspects of educational measurement. The discussion of public policy issues centers around an apparent dichotomy of egalitarianism and elitism in public education, schooling and the public economy,…

The interest in the application of large-scale computerized adaptive testing has served to focus attention on issues that arise when theoretical advances are made operational. Some of these issues stem less from changes in testing conditions and more from changes in testing paradigms. One such issue is that of the order in which questions are…

A group cognitive modification treatment was effective in significantly reducing test anxiety as assessed by (a) test performance, (b) self-reports and (c) grade point average. (Author)

Reasons why there are few incentives for test publishers to make significant innovations in what is tested or how it is tested are given. A brief discussion of research on growth spurts in the brain, hemispheric differences, and other neurological phenomena is followed by a discussion of some conclusions drawn from this work. While skepticism is…

A cognitive process approach is applied to this discussion of the nature and relationship of skills, thinking, and social studies knowledge. To make understanding explicit, the paper addresses: (1) the meaning of cognitive skills and their role in thinking; (2) generic versus specific skills; and (3) implications for the National Assessment of…

This speech deals with the assumptions and approaches underlying educational assessment and suggests alternatives to standardized testing. It is proposed that the assumption that test items can be standardized is at the base of assessment problems; while there are standard mental functions which children develop, there are no standard items that…

Testing procedures developed on younger groups are often inadequate when testing the elderly. Special tests and administration techniques that increase the likelihood that elderly examinees will do their best are described. Psychological examiners must receive special training in testing to do a credible job with the elderly. (Author/BEF)

The history of the Educational Testing Service (ETS) Factor Kits is summarized. The original ETS Factor Kit was developed in 1954 and contained 51 items, three each for each of 15 factors and six for a 16th factor. The next edition was developed in 1963 and included adaptations (clones) of the defining tests instead of the exact copies. These…