This document describes the breadth of the research being conducted in 2008 by the Research and Development Division at Educational Testing Service (ETS). The research described falls into three large categories: (1) Research supported by the ETS research allocation; (2) Research funded by testing programs at ETS; and (3) Research funded by…

Measuring student intelligence has been problematic in the United States since standardized testing first began in the early 1900s. The omnipresence of standardized testing in student populations is illustrated by the most popular contemporary tests which are used by some scholars to advance the notion that intelligence differences between whites…

The chemistry version of the Colorado Learning Attitudes about Science Survey (CLASS-Chem) is a new instrument designed to measure students' (novices') beliefs about chemistry and learning chemistry compared to those of experts (instructors). This survey is intended to measure the effects of students' beliefs on learning, and to understand how…

The development of a 20-item semantic differential assessment instrument for measuring student attitudes toward the subject of chemistry is described (Attitude toward the Subject of Chemistry Inventory-ASCI). Instrument subscales and survey items pertain to interest and utility, anxiety, intellectual accessibility, emotional satisfaction, and…

The Anamnestic Comparative Self Assessment (ACSA) measure of subjective well-being (SWB) aims to reduce the problems of cultural bias and relativity to external standards by allowing people to define the endpoints or "anchors" of the measurement scale. In medical terminology anamnestic denotes "based on memory". The ACSA uses…

Traditional student evaluations of teaching do not adequately assess the essential constructivist-based practices that have been recommended for effective online instruction. There is a need for student evaluation of teaching instruments that are specifically designed to provide online instructors with valid feedback about the effectiveness of…

The purpose of this study was to describe the development and validation of an instrument to identify various dimensions of the computer technology literacy self-assessment scale (CTLS) for elementary school students. The instrument included five CTLS dimensions (subscales): the technology operation skills, the computer usages concepts, the…

Literacy is an issue for many low-income audiences. Using visual information processing theories, the goal was improving readability of a food behavior checklist and ultimately improving its ability to accurately capture existing changes in dietary behaviors. Using group interviews, low-income clients (n = 18) evaluated 4 visual styles. The text…

Free-response (FR) item formats, such as essay questions, are popular in educational assessment. The criticisms against FR items are that they are more expensive to score, take up more testing time, provide less content coverage, and are less reliable than multiple-choice (MC) items. For these reasons, FR items are often combined with MC items.…

Distance education programs for adult learners have been largely neglected by developers of diagnostic instruments to identify students' level of academic preparedness. The purpose of this study was to modify the Learning and Study Strategies Inventory (LASSI) so that it could be used for learners in distance programs (A-LASSI) and to generate…

This booklet presents the Reading Framework for the 1992 and 1994 National Assessment of Educational Progress (NAEP), which contains the rationale for the aspects of reading assessed and the criteria for the development of the assessment. The booklet notes that the new reading assessment examines students' abilities to construct, extend, and…

Because of the Goals 200 Quality Improvement program of the federal government, Head Start agencies are being held more accountable for their employees and the overall operation of their program. To evaluate these more effectively, agencies need an effective employee evaluation instrument. Strategies were implemented in an agency that provides…

When test-takers are offered a choice of essay questions, some questions may be harder than others. If the test includes a common portion taken by all test-takers, an adjustment to the scores is possible. Previously proposed adjustment procedures disregard the test-makers' efforts to create questions of equal difficulty; these procedures tend to…

A method is proposed to assess the importance of differential item functioning (DIF) by estimating the largest possible fraction of the population in which DIF does not occur, or equivalently, the smallest possible portion of the population in which DIF may occur. The approach is based on latent class (C. C. Clogg, 1981) or mixture concepts, and…

The National Association of Boards of Pharmacy (NABP) manages the National Association of Boards of Pharmacy Licensure Examination (NABPLEX). A new Scope of Pharmacy Practice study was completed in 1994, and representatives of NABP and the National Association of Pharmacy Regulatory Authorities of Canada met in 1995 to discuss the possibility of…