In standardized educational testing, test items are reused in multiple test administrations. To ensure the validity of test scores, the psychometric properties of items should remain unchanged over time. In this article, we consider the sequential monitoring of test items, in particular, the detection of abrupt changes to their psychometric…

Serious games are increasingly being explored for use as assessment tools in broad domains. Drawing from research in these domains, we present important advantages and challenges that arise when using games for assessment. In light of this context and as an introduction to this special issue on Serious Games and Assessments, we introduce the…

PISA [Programme for International Student Assessment] will be in the news again this year. The 2018 results are due to be released at the end of 2019 and they usually generate media interest. This Rangahau Whakarapopoto is a research brief which outlines things to watch out for as you think about what the results might mean.

Testing and data integrity on statewide assessments is defined as the establishment of a comprehensive set of policies and procedures for: (1) the proper preparation of students; (2) the management and administration of the test(s) that will lead to accurate and appropriate reporting of assessment results; and (3) maintaining the security of…

Advances have been made in testing optometrists' clinical skills, particularly with the use of simulation techniques. Further research into these techniques will probably receive the most attention, although a shift in research emphasis from correlational studies of test validity and reliability to test development studies is needed. (MSE)

Describes measurement problems associated with computer based testing (CBT) programs when they are part of a computer assisted instruction curriculum. Topics discussed include CBT standards; selection of item types; the contamination of items that arise from test design strategies; and the non-equivalence of comparison groups in item analyses. (8…

After describing deficiencies of psychometric tests in identifying disadvantaged gifted youth, this article presents a system of dynamic assessment and cognitive intervention. The program's theoretical rationale is based on systematic thinking and metacognitive skills. Objectives for program implementation are offered in terms of cognitive,…

Recent experience of test development in Ireland, which had no tradition of formal standardized testing, is described, in order to highlight a number of practical and psychometric problems. It is pointed out that some conventional procedures for developing norm-referenced attainment tests have limitations, especially in countries with centralized…

This article discusses issues and difficulties encountered in efforts at the University of Birmingham (England) to standardize a new psychometric assessment tool, a tactile speed-of-information-processing test for children with blindness. The problem of defining the population on which the test is standardized is seen as particularly difficult.…

This article describes errors resulting from use of standardized language tests using a "normal" sample as the normative comparison group. Resulting errors include, among others, identifying normal children as language impaired, providing misleading profiles of verbal and nonverbal performance, and inability to determine impairment severity.…

Recently, there has been a significant expansion in the use of performance assessment in large scale testing programs. Although there has been significant support from curriculum and policy stakeholders, the technical feasibility of large scale performance assessments has remained a question. This report is intended to contribute to the debate by…

Educational assessment tools are used for accountability; selection and licensure, and to measure the effects of instruction for student diagnosis and treatment. Psychometric instruments currently in use are flawed in two ways: they attempt to rank people on fundamentally multidimensional traits, and the problem of the validity of these…

This technical manual provides all major existing information about the technical characteristics of the Kentucky Instructional Results Information System (KIRIS). The assessment component of the Kentucky Education Reform Act Accountability System was in use between 1991-92 and 1993-94 and was referred to as Cycle One. Two sets of test…

This technical manual provides information about the technical characteristics of the Kentucky Instructional Results Information System (KIRIS), the assessment component of the Kentucky Education Reform Act Accountability System. The time period covered is Accountability Cycle 2, which spanned the school years 1992-93 through 1995-96. Sections of…

With the increasing globalization of human resources practices, a commensurate increase in demand has occurred for multi-language ("global") personality norms for use in selection and development efforts. The combination of data from multiple translations of a personality assessment into a single norm engenders error from multiple sources. This…