In this article the author presents a model that shows how inquiry-based instruction and creative classroom assessment can be used to teach the concepts and principles on which standardized test items are based. To successfully implement this model, the teacher must have a clear understanding of: (1) The ways that the NSES link to instruction and…

The information function is an important statistic in item response theory (IRT) applications. Although the information function is often described as the IRT version of reliability, it differs from the classical notion of reliability from a critical perspective: replication. This article first explores the information function for the…

The purpose of this study was to demonstrate how cognitive and measurement principles can be integrated to create an essentially unidimensional test. Two studies were conducted. In Study 1, test questions were created by using the feature integration theory of attention to develop a cognitive model of performance and then manipulating complexity…

The purpose of this study was to determine how judgments of solo performances recorded at an international piano competition might be affected by excerpt duration (20 versus 60 seconds) and tempo (slow versus fast). Musicians rated performances on six test items. Results indicated that piano majors rated slow excerpts higher than they rated fast…

Testing is essential in education and other social science fields because many assessments, decisions, and policies are made according to the results of testing. The purpose of testing is to estimate a person's ability, that is, latent trait or construct. In a test setting, responses to a set of test items by each individual are recorded. Through…

This article presents a methodology for examining the content and nature of item parcels as indicators of a conceptually defined latent construct. An essential component of this methodology is the 2-facet measurement model, which includes items and parcels as facets of construct indicators. The 2-facet model tests assumptions required for…

Differential item functioning (DIF) analyses are used to identify items that operate differently between two groups, after controlling for ability. The Simultaneous Item Bias Test (SIBTEST) is a popular DIF detection method that matches examinees on a true score estimate of ability. However in some testing situations, like test translation and…

For (0, 1) scored multiple-choice tests, a formula giving test reliability as a function of the number of item options is derived, assuming the "knowledge or random guessing model," the parallelism of the new and old tests (apart from the guessing probability), and the assumptions of classical test theory. It is shown that the formula is a more…

The relationship between two classes of retrieval process--retrieval orientation and retrieval effort--was investigated using electrophysiological (ERP) and behavioural measures. ERPs were recorded during retrieval phases of exclusion tasks in which participants focused on retrieval of either phonological or semantic associates that were generated…

In this research paper we discuss how some multiple-choice questions may be used to improve understanding, to develop and to assess modelling capabilities and as an aid to teaching.

Item-pool management requires a balancing act between the input of new items into the pool and the output of tests assembled from it. A strategy for optimizing item-pool management is presented that is based on the idea of a periodic update of an optimal blueprint for the item pool to tune item production to test assembly. A simulation study with…

Two new tests for a model for the response times on pure speed tests by Rasch (1960) are proposed. The model is based on the assumption that the test response times are approximately gamma distributed, with known index parameters and unknown rate parameters. The rate parameters are decomposed in a subject ability parameter and a test difficulty…

The Bookmark method for setting standards on educational tests is currently one of the most popular standard-setting methods. However, research to support the method is scarce. In this report, we review the published and unpublished literature on this method as well as some seminal work in the area of evaluating standard-setting studies. Our…

A simulation study of a sequential computerized mastery test is carried out with items modeled with the 3 parameter logistic item response theory model. The examinees' responses are either identically distributed, not identically distributed, or not identically distributed together with estimation errors in the item characteristics. The…

This article addresses the relation between item recognition and associative (cued) recall. Going beyond measures of performance on each task, the analysis focuses on the degree to which the contingency between successful recognition and successful recall of a studied item reflects the commonality of memory processes underlying the recognition and…