This demonstration introduces and presents an innovative online cognitive diagnostic assessment, developed to identify the types of cognitive processes that readers use during comprehension; specifically, processes that distinguish between subtypes of struggling comprehenders. Cognitive diagnostic assessments are designed to provide valuable…

Comparability studies between CBT and PPT studied if there were score differences between these two versions. However, there were no consistent results across studies and time. The purpose of this study is to summarize the testing mode effects for K-12 mathematics tests by conducting a meta-analysis. 103 effect sizes of 32 studies were collected…

This study focused on the use of a standardized reading assessment to examine reading comprehension among English language learners (ELLs) and English fluent middle school students, focusing on two text genres: informational and narrative. The Common Core State Standards require students to develop skills in both genres. However, ELLs may not…

No significant body of research examines writing achievement and the specific skills and knowledge in the writing domain for postsecondary (college) students in the U.S., even though many at-risk students lack the prerequisite writing skills required to persist in their education. This paper addresses this gap through a novel…

Assessing speaking is one of the most difficult tasks in computer based language testing. Many countries all over the world face the need to implement standardized language tests where speaking tasks are commonly included. However, a number of problems make them rather impractical such as the costs, the personnel involved, the length of time for…

This study explores correlations between human ratings of essay quality and component scores based on similar natural language processing indices and weighted through a principal component analysis. The results demonstrate that such component scores show small to large effects with human ratings and thus may be suitable to providing both summative…

The No Child Left Behind (NCLB) legislation spawned a plethora of standardized testing services for all the high stakes testing required by the law. We argue that one-size-fits all assessments disadvantage students who are English Language Learners, in the USA, as well as students with limited economic resources, special needs, and not reading on…

Obstacles to the classroom implementation of the fourth grade Math component of Louisiana's web-based testing tutorial were addressed in this informal pilot. Technology integration improved standardized test preparation for students with special needs. Supplemental test preparation sessions give the benefits of (a) increased familiarity with…

Response accuracy and response speed provide separate measures of performance. Psychometricians have tended to focus on accuracy with the goal of characterizing examinees on the basis of their ability to respond correctly to items from a given content domain. With the advent of computerized testing, response times can now be recorded unobtrusively…

Large-scale testing programs are generally based on the assumptions that the test-takers experience standard conditions for taking the test and that everyone will do his or her own work without having prior knowledge of specific questions. These assumptions are not necessarily true. The ways students and educators use to get around standardizing…

This study investigated participants' reactions to computerized testing and assessed the practicability of this testing method in the classroom. A sample of 315 secondary-level students took a computerized and a printed version of a standardized aptitude test battery and a survey assessing their reactions to the computerized testing. Overall…

This paper addresses problems with performance on open-ended (i.e., not multiple choice) test questions administered on paper for students accustomed to writing with computers. The first section summarizes the results of three studies that examined differences between computer and paper-and-pencil test results. The second section identifies three…

At Santa Fe Community College, the development of a biology course and departmental final examination was accomplished in the following stages: (1) faculty reached consensus on course content, major objectives and sub-objectives; (2) faculty contributed final examination questions corresponding to the 10 major course topics to a pool for review…

For many years personalization of achievement testing has been impossible in all but the simplest forms. Recently, item response theory (IRT), or latent trait theory, has emerged as a valuable tool which brings far greater flexibility to the process than had previously been possible. The single parameter Rasch Model, a mathematical model developed…

This study examined the effects of high school course choices, grades, and Grade Ten Assessment Test scores (GTAT) in math and reading, along with race and gender, on student performance on a computerized placement test (CPT) administered upon entry to community colleges in Florida. The sample consisted of 19,736 African-American, white, and…