Modern scale construction techniques have been used to develop scales measuring examiner ratings of examinees' test session behavior (TSB) on Wechsler and Stanford-Binet intelligence tests. This study analyzes data from the Test Session Observation Checklist (TSOC), a measure developed by post hoc rational analysis, from a portion of the Woodcock…

The COLA project has been developing a large bank of assessment items for units across the Scottish further education curriculum since May 2003. These will be made available to learners mainly via colleges' virtual learning environments (VLEs). Many people have been involved in the development of the COLA assessment item bank to ensure a high…

Today, with the requirements of NCLB and state standards, schools are locked into a culture that seems to assume one size fits all. Teachers' focus is on preparing students to pass tests rather than on developing thoughtful curriculum. In this article, the authors discuss how teachers can move away from the constraints of disciplines and topics…

Background: The Approaches to Teaching Inventory (ATI) is structured as two main scales, reflecting a teacher-centred information-transmission approach versus a student-centred conceptual-change approach, each subdivided into intention and strategy subscales. Its use in higher education investigations is increasing and, by default, it is assuming…

Computer-based assessments are becoming more commonplace, perhaps as a necessity for faculty to cope with large class sizes. These tests often occur in large computer testing venues in which test security may be compromised. In an attempt to limit the likelihood of cheating in such venues, randomised presentation of items is automatically…

Test method facet has been considered as an important factor affecting the testee's performance on a test. That is, a test used to assess a particular ability would yield different results when different test methods are used to gauge the same trait. The language of presentation is an aspect of test method conceived of as affecting the performance…

If you ever have students who are reluctant to tell you when they don't understand something--or worse, tell you they understand when they really don't--then here's a book that gives you lots of ways to check for understanding. Learn why typical methods to check for understanding are usually ineffective. And explore formative assessment techniques…

Determining the cross-cultural equivalence of multilingual tests is a challenge that is more complex than simple horizontal equating of test forms. This study examines the functioning of a trilingual test of preschool readiness to determine the equivalence. Different forms of the test have previously been examined using classical statistical…

This report synthesizes the research to date addressing the construct comparability of the SAT Reasoning Test and prior SAT I: Reasoning Test and the series of research studies addressing the equatability and subpopulation invariance of the SAT and SAT I.

In this article, I describe a practical application of the Roussos and Stout (1996) multidimensional analysis framework for interpreting group performance differences on an ESL reading proficiency test. Although a variety of statistical methods have been developed for flagging test items that function differentially for equal ability examinees…

A previous study of new item types for the analytical measure of the Graduate Record Examinations (GRE) General Test found that the new items had many factors labeled verbal reasoning, informal reasoning, formal-deductive reasoning, and quantitative reasoning. The present study examined how processing differed for these item types in the context…

Based on initial Scholastic Aptitude Test (SAT) Verbal pretest data and hypotheses advanced in the research literature, 7 sentence completion and 16 analogy items with extreme levels of differential item functioning (DIF) were selected and then systematically revised and re-administered in an attempt to reduce or eliminate DIF. The apparent…

A multiple choice test item is identified as flawed if it has no single best answer. In spite of extensive quality control procedures, the administration of flawed items to test-takers is inevitable. Common strategies for dealing with flawed items in conventional testing, grounded in the principle of fairness to test-takers, are reexamined in the…

A study was undertaken to determine the effects on essay scores of intermingling handwritten and word-processed versions of student essays. A sample of 32 examinees, each of whom had produced both a handwritten and a word-processed essay, was drawn from a larger group who had participated in a pilot study of item types for The Praxis Series:…

The purpose of this study was to determine whether it is both possible and cost-effective to revise middle-difficulty Graduate Record Examinations (GRE) discrete items in order to produce items of higher or lower difficulty. The basic procedure was to select items of a given difficulty and, by revising the distractors, make them easier or more…