Experimental psychology is witnessing an increase in research on individual differences, which requires the development of new tasks that can reliably assess variations among participants. To do this, cognitive researchers need statistical methods that many researchers have not learned during their training. The lack of expertise can pose…

Because the disciplines of mathematics and statistics are naturally intertwined, designing assessment questions that disentangle mathematical and statistical reasoning can be challenging. We explore the writing statistics assessment tasks that take into consideration potential mathematical reasoning they may inadvertently activate.

Purpose: This study reports on our efforts toward extending the conceptual understanding of content development in physical education by validating content maps as a measurement tool, examining new categories of instructional tasks to describe content development and validating formulae that can be used to evaluate depth of content development.…

Children with specific language impairment (SLI) are particularly sensitive to phonological complexity in their language. Their performance drops when there are specific phonological structures or when complexity increases. A nonword repetition (NWR) test, which aims to assess the phonology of bilingual speakers with and without SLI, should…

The assessments designed for and analyzed in this study used a task-based language design template rooted in theories of language reflecting heteroglossic language practices and funds of knowledge learning theories, which were understood as transforming classroom teaching, learning, and assessment through continua of biliteracy lenses. Using a…

A "knowledge survey" and a formative evaluation process led to major changes in an instructor's course and teaching methods over a 5-year period. Design of the survey incorporated several innovations, including: a) using "confidence survey" rather than "knowledge survey" as the title; b) completing an instructional…

The validation of ability scales describing multidimensional skills is always challenging, but not impossible. This study applies a multistage, criterion-referenced approach that uses a framework of aligned texts and reading tasks to explore the validity of the ACTFL and related reading proficiency guidelines. Rasch measurement and statistical…

Objectives: The purpose of this article is to create transparency for the psychometric methods employed for the development of the Association of Social Work Boards' (ASWB) exams. Results: The article includes an assessment of the macro (political) and micro (statistical) environments of testing social work competence. The seven-step process used…

This study employed Bachman and Palmer's (2010) Assessment Use Argument framework to investigate to what extent the use of a second language oral test as an exit test in a Hong Kong university can be justified. It also aimed to help test developers of this oral test identify the most critical areas in the current test design that might need…

The main purpose of this research is 1) to establish a framework for the test development and the constructs of writing performance test, 2) to implement a developed writing performance assessment, and 3) to examine the degree of reliability and validity of the assessment tasks and rating scales. Construct-based processing approach to testing…

The objective of this program was to develop candidate pilot performance measures for five undergraduate pilot training (UPT) contact training maneuvers flown in the T-37B aircraft. The work included development and application of a method of analyzing operator performance tasks for purposes of identifying candidate measures. This resulted in…

In order to assist the newly formed rehabilitation counseling program at Northeastern University in curriculum and instructional planning, a job task analysis was conducted. The sample consisted of 55 employed rehabilitation counselors in the New England region from both state agencies and rehabilitation facilities. The results of the study were…

Asserting the importance of proper emphasis in curriculum content, this paper investigated some of the problems of present day training evaluation techniques, and described methods for analyzing training effectiveness through valid task analysis inventory data. Parametric and nonparametric statistical procedures were discussed, as well as a matrix…

The success of objectives-based programs depends to a considerable extent on how effectively students and teachers assess mastery of objectives and make decisions for future instruction. While educators disagree on the usefulness of criterion-referenced tests the position taken in this monograph is that criterion-referenced tests are useful, and…

Materials intended for driving knowledge test development use by operational licensing and education agencies were prepared. Candidate test items were developed, using literature and operational practice sources, to reflect current state-of-knowledge with respect to principles of safe, efficient driving, to legal regulations, and to traffic…