Lissitz and Samuelsen (2007) propose a new framework for validity theory and terminology, emphasizing a shift in theory and practice toward issues of test content rather than constructs. The author of this article argues that several of Lissitz and Samuelsen's critiques of validity theory focus on previously considered, but subsequently discarded,…

This article describes the revision of the White Racial Consciousness Development Scale (D. Claney & W. M. Parker, 1989). A multistage approach including item generation, item refinement and selection, and evaluation of score validity and reliability was used to test construction and validation. Implications for theory, practice, and future…

The Academy for Educational Development (AED) sent a research team to the University of Dayton (UD) on November 5-7, 2008, to conduct interviews with individuals who played significant roles in the university's teacher preparation program (see Appendix A). These interviews, along with additional materials provided by UD and identified by the AED…

In this article, Structural communication grid (SCG), an alternative measurement and evaluation technique, has been firstly summarised and the design, development and implementation of a computer based SCG system have been introduced. The system is then tested on a sample of 154 participants consisting of candidate students, science teachers and…

We developed equivalent, alternate forms of easyCBM[R] in reading (n=20 forms) and mathematics (n=13 forms) with different skills reflective of the National Reading Panel (NRP) and the National Council of Teachers of Mathematics (NCTM), respectively. We then took three forms to use as screening measures in the fall, winter, and spring so educators…

An approach to studying children's strategies in social interactions and in material tasks has been developed for use with children 3 through 6 years of age. The Children's Strategies Assessment System (CSAS) provides both a time and an event sample of behaviors and records children's strategies under each of five constructs: involvement,…

Describes a program system which was developed for the purpose of making estimates about the nature of the distribution of test scores which will result from an administration of a test composed of items of which estimates of item-difficulty and discrimination are available. (Author/RC)

Although the issue of dimensionality of the data obtained from educational and psychological tests has received considerable attention, the terms "unidimensional" and "multidimensional" have not been used very precisely. One use of the term dimensionality is to refer to the number of hypothesized psychological constructs…

A study developed a valid and reliable measure to assess adult attitudes to continuing education. It determined the relationship between attitudes and participation in adult education and identified differences between the attitudes of subgroups of the adult population. A total of 275 adults from the central New Jersey area completed the Adults'…

Modern test construction strategies in the areas of personality and psychopathology differ in the use of disguise within test stimulus material. Previous research on the validity of using disguised test item content has favored the rational strategy of test construction which views disguise as a liability under normal test-taking circumstances.…

Psychometric issues confronted when implementing a system of item response theory (IRT) tools for test development at the Educational Testing Service (ETS) are discussed. These issues include selecting and assessing the appropriateness of IRT models, choosing methods of IRT scaling for item pools, considering test scoring strategies, and applying…

The background and results of an effort to use dBASE II, a microcomputer database management package, to establish, maintain, and update an item bank useful in a complex test development process are presented. The paper explores some of the perspectives and considerations in designing such a database which make the test development process easier,…

The study examined the effect of test modifications on the performance of 10 handicapped preschoolers on the Stanford-Binet Intelligence Scale (Form L-M). Adaptations of both stimulus and response modes were designed and constructed for subtests at the preschool levels on the Stanford-Binet. Attempts were made to maintain the functional…

This paper summarizes the steps that led to the development of new test purchaser qualification forms (TPQFs), with major emphasis on a form for an educational test publisher. Three separate research studies, conducted by the Test User Qualifications Working Group (TUQWG) of the Joint Committee on Testing Practices, constituted the research base…