Across education, certification and licensure, there are repeated calls for the development of assessments that target "higher-order thinking," as opposed to mere recall of facts. A common assumption is that this necessitates the use of constructed response or essay-style test questions; however, empirical evidence suggests that this may…

In developing alternate assessments based on modified academic achievement standards (AA-MAS), several states have modified existing test items with the aim of enhancing accessibility and reducing difficulty for students with disabilities. Using Grade 8 multiple-choice test items in unmodified and modified forms, two studies examined student…

Students with disabilities must meet many testing demands, given the current emphasis on accountability and state competency testing. The purpose of this project was to develop and field test a computerized program to teach the Test-Taking Strategy (Hughes, Schumaker, Deshler, & Mercer, 1988) to secondary-level students with disabilities. The…

Clear descriptions of job expertise are required to support applications and improvements in personnel training and job performance. This report describes a practical approach to task analysis that integrates the issues, content, and methods of cognitive science and personnel psychology. Cognitively oriented task analysis employs a breadth, then…

Within an evidentiary framework for operationally defining academic English language proficiency (AELP), linguistic analyses of standards, classroom discourse, and textbooks have led to specifications for assessment of AELP. The test development process described here is novel due to the emphasis on using linguistic profiles to inform the …

The problems of validity and fairness involved in multiple-choice critical thinking tests can be lessened by using verbal reports of examinees' thinking during the process of developing such tests in order to retain only those items which rely on critical thinking skills to obtain the correct answer. Multiple-choice testing can lead to unfair…

This paper describes the task analysis of performance-based science tasks that were designed for the 1994 National Assessment of Educational Progress (NAEP) science assessment, now postponed until 1996, and field tested in 1993. A brief description of the science performance tasks is followed by a description of the task analyses performed and a…

Analyses of the cognitive activity displayed by students on existing innovative assessments in science were conducted. The project has worked with pilot alternative assessment programs in Connecticut and California to document the match or mismatch between the skills and processes that the assessment is designed to tap and those actually elicited.…