While score comparability across test forms typically relies on common (or randomly equivalent) examinees or items, innovations in item formats, test delivery, and efforts to extend the range of score interpretation may require a special data collection before examinees or items can be used in this way--or may be incompatible with common examinee…

Consideration of the influence of English language skills during testing is an understandable requirement for fair and valid cognitive test interpretation. Several professional standards and expert recommendations exist to guide psychologists as they attempt to engage in best practices when assessing English learners (ELs). Nonetheless, relatively…

"Linking" is a term given to a general class of procedures by which one represents scores X on one test or measure in terms of scores Y on another test or measure. A recent taxonomy by Holland and Dorans (2006; Holland, 2007) organizes the various types of links into three broad categories: prediction, scale aligning, and equating. In…

The article "Thinking About Linking" by Newton (2010) presents a novel philosophical perspective on the way that educational assessments should be linked. Newton starts by describing the linking framework as it was characterized in various publications and identifies a cross-cultural dimension in the definitions and uses of test…

The purpose of this document is to provide background information that will be useful in interpreting the 2007 results from the Trends in International Mathematics and Science Study (TIMSS) by comparing its design, features, framework, and items with those of the U.S. National Assessment of Educational Progress and another international assessment…

The root of problems in standardized testing is the test makers' goal of lining up children along a single line from highest-scoring to lowest-scoring individual. Standardized tests reflect no sense, no reality, and no logic. (MJB)

Compared principal component anlaysis with hierarchical cluster analysis of a psychodiagnostic test battery for children. Results are discussed within a multidimensional framework of cognitive abilities. The structure of the battery of tests included general intelligence, auditory and visual learning, academic achievement, and auditory…

Rasch and classical test analysis methods were compared with respect to their similarities and differences in the identification of noninformative items and implausible person records. Using computer simulated data with known parameters, each model was evaluated in terms of its effectiveness in: (1) identifying noninformative or "bad"…

THE CLOZE READABILITY PROCEDURE WAS EXAMINED TO DETERMINE ITS UTILITY AS A DEVICE FOR EVALUATING THE EFFECTIVENESS OF INSTRUCTIONAL PROGRAMS. THE POSSIBILITY OF DEVELOPING A METHOD, WHICH INCORPORATES THE CLOZE PROCEDURE, FOR MAKING CRITERION REFERENCE TESTS OVER VERBALLY PRESENTED INSTRUCTION WAS ALSO INVESTIGATED. A DISCUSSION OF CLOZE RESEARCH,…

This paper describes the rationale for the Defining Issues Test (DIT), an objective test of moral judgment which attempts to improve upon three aspects of Kohlberg's research: data collection, categorization of moral judgments (the scoring system), and method of indexing a subject's progress in a developmental sequence. In each case, the way in…

Reappraises the validity and reliability of Vocabulary and Block Design (V-VD) as a short form of the Wechsler Adult Intelligence Scale (WAIS), the Wechsler Intelligence Scale for Children (WISC), and the Wechsler Preschool and Primary Scale of Intelligence (WPPI). Presents a table for converting the sum of scaled scores into an estimate of Full…

A study examined the relationship of native language and level of English proficiency to the structure of the Test of English as a Foreign Language (TOEFL). Using all of the information provided by various responses to the test's items (the four alternatives, omitted, and not reached), the items' interrelations were analyzed by three-way…

Two assessment agencies, the National Assessment of Educational Progress (NAEP) in the U.S. and the International Association for the Evaluation of Educational Achievement (IEA), provide the most promising framework for comparing U.S. education with education in other nations. These agencies can cooperate to resolve technical issues and make data…

The construction of an exploratory test dealing with concepts relevant to mathematics was required as part of the New Canadian Study. The test devised for this purpose has three sections dealing with the sorting of objects. In Sort One, 10 lines are sorted into groups of two; in Sort Two, numbers from 1 to 10 are sorted; and, in Sort Three,…

A general process for testing the feasibility of applying alternative mathematical or statistical models to the solution of a practical problem is presented and flowcharted. The system is used to compare five models for test equating: (1) anchor test equating using classical test theory; (2) anchor test equating using the one-parameter logistic…