This research is motivated by the perspective that when empirical studies and assessment frameworks inform each other, assessments can enrich science education and strengthen its connections to modern science. The research proposes a bioenergy competency assessment for science education. It uses an argument-based approach to validation. Multiple…

The OECD Programme for International Student Assessment (PISA) examines what students know in reading, mathematics and science, and what they can do with what they know. It provides the most comprehensive and rigorous international assessment of student learning outcomes to date. Results from PISA indicate the quality and equity of learning…

Purpose: Against a backdrop of high-stakes assessment policies in the USA, this paper explores the challenges, promises and the "state of the art" with regard to designing standardized achievement tests and educational assessment systems that are instructionally useful. Authors deliberate on the consequences of using inappropriately…

Variation in test performance among examinees from different regions or national jurisdictions is often partially attributed to differences in the degree of content correspondence between local school or training program curricula, and the test of interest. This posited relationship between test-curriculum correspondence, or "alignment,"…

A primary goal of standards-based statewide achievement tests is to classify students into achievement levels that enable valid inferences about student content area knowledge and skill. Explicating how knowledge and skills are expected to differ in complexity in achievement level descriptors, and how that complexity is related to empirical item…

The study aimed at investigating Jordanian EFL teachers' self-reported frequencies of using the procedures of preparing, correcting, analyzing, interpreting an achievement test, and discussing its results with students. To achieve this, a 31-item questionnaire was used. The questionnaire was administered to 118 basic stage EFL teachers after…

The purpose of this document is to provide background information that will be useful in interpreting the 2007 results from the Trends in International Mathematics and Science Study (TIMSS) by comparing its design, features, framework, and items with those of the U.S. National Assessment of Educational Progress and another international assessment…

This fastback provides information about what tests can and cannot do, how they are constructed, and how they are used and misused. It offers suggestions about how best to interpret test results. The chapters are: (1) "A Test on Testing"; (2) "Basic Considerations"; (3) "Standardized Tests"; (4) "Performance Tests"; (5) "Interpreting Test Scores";…

A computer program generating question series for achievement examinations was presented and the relative reliability of computer-generated and instructor-selected items was investigated. To provide validity for examinations generated by an original computer program, representative processes of construction and sampling were operationally defined.…

The extent of American literacy is examined and the concept of literacy defined. Literacy can be measured through responsible testing practices and can be improved through responsive public programs. Assessing abilities and correcting deficiencies are seen as priorities for the future. (Author/MLW)

A DISCUSSION OF TEST VARIABLES AND THE TESTING PROGRAM OF THE PROJECT WAS INITIALLY PRESENTED IN THIS DOCUMENT. CAUTION WAS PARTICULARLY EMPHASIZED IN THE INTERPRETATION OF RESULTS USING STANDARD ACHIEVEMENT TESTS WITH SUBJECTS FROM THE MODESTO MULTI OCCUPATIONAL PROJECT. RECOMMENDATIONS FOR IMPROVED PROGRAM EVALUATION INCLUDED ADDITIONAL…

This article argues that the validity of standardized achievement test-score interpretation and use is problematic; consequently, confidence and trust in such test scores may often be unwarranted. The problem is particularly severe in high-stakes situations. This essay provides a context for understanding standardized achievement testing, then…

This study introduces the individual consistency index (ICI), which measures the extent to which patterns of responses to parallel sets of items remain consistent over time. ICI is used as an error diagnostic tool to detect aberrant response patterns resulting from the consistent application of erroneous rules of operation. (Author/PN)

Investigates the convergence of three measures on a representation of cognitive structure and examines the correspondence between these representations and the representation of subject matter structure. (Author/DEP)

A unified framework for validating criterion-referenced test (CRT) interpretation is proposed. Using functional literacy as an illustration, the instructional outcomes assessed are called achievement constructs, and described in psychological and behavioral terms. The proposed construct validation methods can yield tests more closely linked to…