Several Web sites have emerged in recent years that encourage students to upload old exams to build a bank of test questions and answers that can be consulted by other students. This article reports that some professors have raised concerns about these sites, arguing that these could be used to cheat, especially if professors reuse old tests.…

Even though researchers agree on the hierarchical structure of intelligence there is considerable disagreement on the g-saturation of the lower stratum-two factors. In this article it is argued that the mixed evidence in the research literature can be at least partially attributed to the construct representation of the individual tests used to…

We suggest one redefinition of common clusters of questions used to analyze student responses on the Force and Motion Conceptual Evaluation. Our goal is to propose a methodology that moves beyond an analysis of student learning defined by correct responses, either on the overall test or on clusters of questions defined solely by content. We use…

Although computerized adaptive tests have enjoyed tremendous growth, solutions for important problems remain unavailable. One problem is the control of item exposure rate. Because adaptive algorithms are designed to select optimal items, they choose items with high discriminating power. Thus, these items are selected more often than others,…

The graded response (GR) and generalized partial credit (GPC) models do not imply that examinees ordered by raw observed score will necessarily be ordered on the expected value of the latent trait (OEL). Factors were manipulated to assess whether increased violations of OEL also produced increased Type I error rates in differential item…

The study examined a new asynchronous model for online teaching, learning and assessment, called OTLA. It is designed for higher-education institutions and is based on LMS (Learning Management System) as well as other relevant IT tools. The new model includes six digital basic components: text, hypertext, text reading, lectures (voice/video),…

This manual contains information about the American College Test (ACT) Plan® program. The principal focus of this manual is to document the Plan program's technical adequacy in light of its intended purposes. This manual supersedes the 2011 edition. The content of this manual responds to requirements of the testing industry as established in the…

Multiple factors have influenced testing agencies to more carefully consider the manner and frequency in which pretest item data are collected and analyzed. One potentially promising development is judges' estimates of item difficulty. Accurate estimates of item difficulty may be used to reduce pretest samples sizes, supplement insufficient…

In order to provide effective social, emotional, and behavioral supports to all students, there is a need for formative assessment tools that can help determine the responsiveness of students to intervention. Schoolwide positive behavior support (SWPBS) is one framework that can provide evidence-based intervention within a 3-tiered model to reach…

Fifty percent of college-bound students graduate from high school underprepared for mathematics at the post-secondary level. As a result, thirty-five percent of college students take developmental mathematics courses. What is even more shocking is the high failure rate (ranging from 35 to 42 percent) of students enrolled in developmental…

The success of all students, including students with disabilities, on statewide assessments in mathematics and reading/English language arts has been examined closely. This is due, in part, to the role of these content areas in school accountability for the Elementary and Secondary Education Act (ESEA) known as "No Child Left Behind" (NCLB).…

The psychometric considerations and challenges associated with including constructed response items on tests are discussed along with how these issues affect the form assembly specifications for mixed-format exams. Reliability and validity, security and fairness, pretesting, content and skills coverage, test length and timing, weights, statistical…

Standardized achievement tests that are used for assessment and accountability purposes may not provide reliable and valid outcomes for English language learners (ELLs) because extraneous sources may confound the outcome of assessments for these students. Performance assessments, by contrast, may offer opportunities for these students to present a…

Current accountability reform requires annual assessment for all students, including students with disabilities. Testing accommodations are one way to increase access to assessments while maintaining the validity of test scores. This paper provides findings from an exploratory logistic regression analysis of predictors of four accommodations used…

The current study identified socioeconomic status (SES) group differences in student performance on an eighth grade mathematics assessment derived from the Third/Trends in International Mathematics and Science Study (TIMSS) 2003. Differential item functioning (DIF) methodology was applied to examine SES group differences on item performance for…