Aviation English proficiency is a core competency in the global air traffic controller profession. There is, however, growing concern about the current ineffective paper-based assessment methods and the severe lack of interactive online testing for such a critical profession, one that should be ideally assessed in an authentic task and situation…

Two experiments extend the ecological validity of tests of hemispheric interaction in three novel ways. First, we present a broad class of naturalistic stimuli that have not yet been used in tests of hemispheric interaction. Second, we test whether probable differences in complexity within the class of stimuli are supported by outcomes from…

Assessment is an important aspect of medical education because it tests students' competence and motivates them to study. Various assessment methods, with and without images, are used in the study of anatomy. In this study, we investigated the use of extended matching questions (EMQs). To gain insight into the influence of images on the…

This paper describes efforts to bring principled assessment design to a large-scale, high-stakes licensure examination by employing the frameworks of Assessment Engineering (AE), the Revised Bloom's Taxonomy (RBT), and Cognitive Task Analysis (CTA). The Uniform CPA Examination is practice-oriented and focuses on the skills of accounting. In…

The traveling salesman problem (TSP) is a combinatorial optimization problem that requires finding the shortest path through a set of points ("cities") that returns to the starting point. Because humans provide heuristic near-optimal solutions to Euclidean versions of the problem, it has sometimes been used to investigate human visual…

In this article, we highlight the need for a precisely defined construct in score-based validation and discuss the contribution of cognitive theories to accurately and comprehensively defining the construct. We propose a framework for integrating cognitively based theoretical and empirical evidence to specify and evaluate the construct. We apply…

Clear descriptions of job expertise are required to support applications and improvements in personnel training and job performance. This report describes a practical approach to task analysis that integrates the issues, content, and methods of cognitive science and personnel psychology. Cognitively oriented task analysis employs a breadth, then…

An information-processing assessment of the construct validity of aptitude tests is presented. It is stated that aptitude tests have been rather successful because they possess high construct validity, although the constructs in terms of which the tests may be most profitably understood are information-processing rather than psychometric ones. It…

Fifty-five recent studies of individual differences (IDs) in elementary cognitive tasks (ECTs) are reviewed. Twenty-five data sets are examined, analyzed, or reanalyzed by factor analysis. The following promising dimensions are identified: basic perceptual processes, reaction and movement times, mental comparison and recognition tasks, retrieval…

An information processing approach was applied to the development and validation of a test battery intended for personnel selection, classification, and guidance; and design of training programs. The approach specifies that tests should measure specific cognitive processes and basic abilities, rather than prior experience. Tests should be short,…

An information processing approach was applied to the development and validation of a test battery intended for personnel selection, classification, and guidance; and design of training programs. The approach specifies that test should measure specific cognitive processes and basic abilities, rather than prior experience. Tests should be short,…

An information processing approach was applied to the development and validation of a test battery intended for personnel selection, classification, and guidance; and design of training programs. The approach specifies that tests should measure specific cognitive processes and basic abilities, rather than prior experience. Tests should be short,…

This paper describes the task analysis of performance-based science tasks that were designed for the 1994 National Assessment of Educational Progress (NAEP) science assessment, now postponed until 1996, and field tested in 1993. A brief description of the science performance tasks is followed by a description of the task analyses performed and a…

This book brings together a series of empirical studies into the use of pedagogical tasks for second language learning, with a view to better understanding the structure of tasks, their impact on students, and their use by teachers. This edited volume starts with an introduction to the background and key issues in the topic area. Each section…

An ongoing series of experiments has extended Rose's information processing approach to job performance assessment. Each study investigated cognitive tasks from the literature on memory, psycholinquistics, and visual information processing, for potential inclusion in the test battery. Each task was then evaluated against three criterion areas: (1)…