Item compromise has long posed challenges in educational measurement, jeopardizing both test validity and test security of continuous tests. Detecting compromised items is therefore crucial to address this concern. The present literature on compromised item detection reveals two notable gaps: First, the majority of existing methods are based upon…

Scoring procedures for the constructed-response (CR) items in large-scale mixed-format educational assessments often involve checks for rater agreement or rater reliability. Although these analyses are important, researchers have documented rater effects that persist despite rater training and that are not always detected in rater agreement and…

The goal in personalized assessment is to best fit the needs of each individual test taker, given the assessment purposes. Design-In-Real-Time (DIRTy) assessment reflects the progressive evolution in testing from a single test, to an adaptive test, to an adaptive assessment "system." In this paper, we lay the foundation for DIRTy…

The goal in personalized assessment is to best fit the needs of each individual test taker, given the assessment purposes. Design-in-Real-Time (DIRTy) assessment reflects the progressive evolution in testing from a single test, to an adaptive test, to an adaptive assessment "system." In this article, we lay the foundation for DIRTy…

Assessment is a fundamental element in successful teaching and learning. However, few research studies have examined the assessment practices implemented by faculty in higher education. It is believed that testing has become the primary method of assessment, which could adversely impact student learning. The purpose of this descriptive…

Mixed-format assessments are increasingly being used in large scale standardized assessments to measure a continuum of skills ranging from basic recall to higher order thinking skills. These assessments are usually comprised of a combination of (a) multiple-choice items which can be efficiently scored, have stable psychometric properties, and…

Proponents of performance assessments purport that they allow more options for student choice and autonomy and, therefore, are more motivating and more preferred by students. This study explored the role of stakes and the student's familiarity with the format in these examination preferences. A survey of 148 college students suggested that: their…

In this article we present results from a study investigating the impact of three state exit exam systems on teaching and learning in college-preparatory schools. The study compares one state with a traditionally more centralized exam regime, one state that is more de-centralized and one state that has recently switched to more centralized…

In this article, Structural communication grid (SCG), an alternative measurement and evaluation technique, has been firstly summarised and the design, development and implementation of a computer based SCG system have been introduced. The system is then tested on a sample of 154 participants consisting of candidate students, science teachers and…

This study aimed to provide evidence to guide decisions on the type and timing of assessments in a graduate medical programme, by identifying whether students from particular degree backgrounds face greater difficulty in satisfying the current assessment requirements. We examined the performance rank of students in three types of assessments and…

"Classroom Assessment in Action" clarifies the multi-faceted roles of measurement and assessment and their applications in a classroom setting. Comprehensive in scope, Shermis and Di Vesta explain basic measurement concepts and show students how to interpret the results of standardized tests. From these basic concepts, the authors then…

A study examined state-mandated literature assessment procedures and undertook a content analysis of tests produced by proprietary testing companies and textbook producers in order to ascertain how literature achievement is assessed in the United States. Results indicated that 61% of the school systems assess literature as part of an assessment of…

Data from the California Learning Assessment System mathematics assessment were used to examine issues that arise when scores from different assessment modes are combined. Multiple-choice, open-ended, and investigation items were combined in a test across three test forms. Results illustrate the difficulties faced in evaluating combined…

This paper explores the development of universal design and considers its application to large-scale assessments. Universal design is a concept that originated in the field of architecture, but quickly expanded into environmental initiatives, recreation, the arts, health care, and now, education. In addition to the concept's application to…

Since acceptable writing is essential to success in job training programs and in many entry-level jobs, a writing sample was included in the Training and Employment Prerequisites Survey, a multiple-choice test about skills like mechanics, usage, and spelling. The two writing prompts asked students to give directions for finding a location in a…