The present study explored the comparability in performance scores between the computer-delivered and face-to-face modes for the two speaking tests in the Vietnamese Standardized Test of English Proficiency (VSTEP) (the VSTEP.2 and VSTEP.3-5 Speaking tests) according to Vietnam's Six-Level Foreign Language Proficiency Framework (VNFLPF) and test…

This research study investigates the impact of the rapid transition from paper-based to online administration of the State of Texas Assessments of Academic Readiness (STAAR) exams on student performance in a South Texas school district. The transition, mandated by House Bill 3261, presented Texas public schools with a tight timeline for adapting…

Standardized assessments are widely used to determine access to educational resources with important consequences for later economic outcomes in life. However, many design features of the tests themselves may lead to psychological reactions influencing performance. In particular, the level of difficulty of the earlier questions in a test may…

In this study we investigated the potential for a shared-first-language (shared-L1) effect on second language (L2) listening test scores using differential item functioning (DIF) analyses. We did this in order to understand how accented speech may influence performance at the item level, while controlling for key variables including listening…

Prior research suggests that males outperform females, on average, on multiple-choice items compared to their relative performance on constructed-response items. This paper characterizes the extent to which gender achievement gaps on state accountability tests across the United States are associated with those tests' item formats. Using roughly 8…

Nearly two dozen states now administer online exams. These tests have real consequences: their results feed into accountability systems, which have been used for more than a decade to hold schools and districts accountable for their students' learning. We examine the rollout of computer-based testing in Massachusetts over 2 years to investigate…

This research study describes the correlations between student performance and examination format in a higher education teaching and research institution. The researchers employed a quantitative, correlational methodology utilizing linear regression analysis. The data was obtained from undergraduate student test scores over a three-year time span.…

The purpose of this handbook is to acquaint principals and teachers with the California Achievement Tests, mandated by the Maryland State Department of Education. Reports of the test results are also discussed. The first chapter describes the test and provides examples of question formats. A table of the objectives measured is also included. The…

"Classroom Assessment in Action" clarifies the multi-faceted roles of measurement and assessment and their applications in a classroom setting. Comprehensive in scope, Shermis and Di Vesta explain basic measurement concepts and show students how to interpret the results of standardized tests. From these basic concepts, the authors then…

The topic of this paper is the second of a two-faceted problem involving achievement testing in the United States. The first facet is the lack of correspondence between test content and intended student outcomes in school districts, and the second facet is "test score pollution." Test score pollution describes instances where test scores for a…

The effect on students' scores of different item formats used in standardized reading achievement tests was investigated. Thirty-one bilingual Mexican-American second grade students were given a phonics test using four different formats derived from three standardized reading achievement tests. The formats sampled identical content. A two-way…

Tips on improving student test scores fall into two categories: format training and environmental conditions. Environmental conditions include notifying parents of the test, emphasizing the importance of the test, and giving the test in familiar surroundings. Format training includes explaining multiple-choice options and answer sheets. (MLF)

This paper addresses problems with performance on open-ended (i.e., not multiple choice) test questions administered on paper for students accustomed to writing with computers. The first section summarizes the results of three studies that examined differences between computer and paper-and-pencil test results. The second section identifies three…

This report is a review and analysis of the psychometric literature on the topic of out-of-level testing. Out-of-level testing refers to the practice of using a level of the test other than the test taken by most of the students in a student's current grade level. Much of the research on out-of-level testing was conducted in the 1970s and 1980s,…

The issue of parallel forms is of paramount importance for producers of standardized tests. With increasing emphasis being placed on standardized test results it is necessary that each student achieve the same standard score regardless of the form he or she was administered. In the case of the American College Testing (ACT) Assessment Program,…