This article investigates several questions regarding the impact of different item formats on measurement characteristics. Constructed response (CR) items and multiple choice (MC) items obviously differ in their formats and in the resources needed to score them. As such, they have been the subject of considerable discussion regarding the impact of…

This investigation focused on a group of 17 faculty drawn from disciplines in the humanities social sciences and natural sciences. Using in-depth interviews, focus group discussions and qualitative coding strategies, this study examined how faculty conceptualized the term critical thinking (CT), and how they assessed for it in general education…

There is much debate on the merits and pitfalls of standardized tests for college admission, with questions regarding the format (multiple-choice versus constructed response), cognitive complexity, and content of these assessments (achievement versus aptitude) at the forefront of the discussion. This study addressed these questions by…

The valuation of academic achievements in students with severe language impairment is problematic if they also have difficulties in sustaining attention and in praxic skills. In severe autism all of these difficulties may occur together. Multiple-choice tests offer the advantage that simple praxic skills are required, allowing the tasks to be…

To design a series of assessments that could be used to compare the learning gains of high school students studying the cardiopulmonary system using traditional methods to those who used a collaborative computer simulation, called "Mr. Vetro". Five teachers and 264 HS biology students participated in the study. The students were in…

In evaluating the relationship between two measures across different groups (i.e., in evaluating "differential validity") it is necessary to examine differences in correlation coefficients and in regression lines. Ordinary least squares (OLS) regression is the standard method for fitting lines to data, but its criterion for optimal fit…

The Force Concept Inventory (FCI) is a multiple choice test designed to monitor students' understanding of the conceptual domain of force and related kinematics (Hestenes et al. "Physics Teacher" 30:141-158 1992; Halloun et al., 1995, Online at http://modeling.asu.edu/R&E/Research.html). It has gained wide popularity among both…

In this report, an alternative item response theory (IRT) observed score equating method was newly developed. The proposed equating method was illustrated with two real data sets and the equating results were compared to those of traditional IRT true score and IRT observed score equating methods. Using three loss indices, the new method appeared…

Traditional data mining techniques have been extensively applied to find interesting patterns, build descriptive and predictive models from large volumes of data accumulated through the use of different information systems. The results of data mining can be used for getting a better understanding of the underlying educational processes, for…

No matter where teachers, state officials, and testing experts stand on the debate about school accountability, they generally agree that the United States' current multiple-choice-dominated Kinder-12 tests are, to use language borrowed from the No Child Left Behind (NCLB) Act, "in need of improvement." Now, federal officials are…

This study uses PISA cycle 3 field trial data to investigate the relationships between gender differential item functioning (DIF) across countries and test languages for science items and their formats and the four other dimensions defined in PISA framework: focus, context, competency, and scientific knowledge. The data used were collected from 60…

The present study is concerned with assessing Logo programming experiences among seventh grade students. A formal multiple-choice test and five performance tasks were used to collect data. The results provided that students' performance was better than the expected score by the probabilistic laws, and a very low correlation between their Logo…

Multiple-choice (MC) examinations are becoming increasingly popular in higher education because they can be used effectively to assess breadth of knowledge in large cohorts of students. This present research investigated psychology students' performance on, and experiences of, MC examinations with and without correction for guessing. In Study 1,…

The purpose of this study is to determine the extent of scale drift on a test that employs cut scores. It was essential to examine scale drift for this testing program because new forms in this testing program are often put on scale through a series of intermediate equatings (known as equating chains). This process may cause equating error to…

In recent years, improvements in technology have enhanced the possibilities of teaching and learning various subjects. This is specially the case in foreign language instruction. The use of technology and multimedia brings new opportunities for learning different areas of language. In this regard, the present study attempts to find out if the use…