This article provides a detailed description of three factors (specification of the ability distribution, numerical integration, and frame of reference for the item parameter estimates) that might affect the item parameter estimation of the three-parameter logistic model, and compares five item calibration methods, which are combinations of the…

Competence data from low-stakes educational large-scale assessment studies allow for evaluating relationships between competencies and other variables. The impact of item-level nonresponse has not been investigated with regard to statistics that determine the size of these relationships (e.g., correlations, regression coefficients). Classical…

This study aimed to identify and analyze the patterns of final exam questions prepared by English teachers for the 9th and 10th grades and to analyze all the revision questions presented in the English language textbooks in Jordan, based on Bloom's taxonomy to determine the nature and types of these questions. The sample of the study consisted of…

Seeking evidence to support content validity is essential to test validation. This is especially the case in contexts where test scores are interpreted in relation to external proficiency standards and where new test content is constantly being produced to meet test administration and security demands. In this paper, we describe a modified…

Stopping rules for fixed-form tests with graduated item difficulty are intended to stop administration of a test at the point where students are sufficiently unlikely to provide a correct response following a pattern of incorrect responses. Although widely employed in fixed-form tests in education, little research has been done to empirically…

The present study used process data from a computer-based problem-solving task as indications of behavioural level of test-taking effort, and explored how behavioural item-level effort related to overall test performance and self-reported effort. Variables were extracted from raw process data and clustered. Four distinct clusters were obtained and…

The quality of multiple-choice questions (MCQs) as well as the student's solve behavior in MCQs are educational concerns. MCQs cover wide educational content and can be immediately and accurately scored. However, many studies have found some flawed items in this exam type, thereby possibly resulting in misleading insights into students'…

The Mineralogy Concept Inventory (MCI) is a statistically validated 18-question assessment that can be used to measure learning gains in introductory mineralogy courses. Development of the MCI was an iterative process involving expert consultation, student interviews, assessment deployment, and statistical analysis. Experts at the two universities…

While research on online tests in higher education is steadily growing, there is little evidence in the literature of the use of learning management systems (LMS), such as Blackboard™, as rich sources of data on online tests practices. This paper reports on an investigation that used data from Blackboard™ LMS to gain insight into the purpose for…

In physics education, assessments address various forms of scientific knowledge. Most of the existing test instruments emphasise the assessment of content knowledge. These tests fail to measure the epistemic aspects of science. Thus, assessing epistemic knowledge is a theme that demands investigation. This study applies Rasch analysis to help…

High Order Thinking Skills (HOTS) are a significant part of the implementation of the 2013 Curriculum to develop student competencies in the 21st century. Not only in the context of learning are HOTS considered important. They contribute to the National Examination held in Indonesia, so careful preparation for this exam is needed. Chemistry has…

Item nonresponses are prevalent in standardized testing. They happen either when students fail to reach the end of a test due to a time limit or quitting, or when students choose to omit some items strategically. Oftentimes, item nonresponses are nonrandom, and hence, the missing data mechanism needs to be properly modeled. In this paper, we…

Settings-based approaches have become an increasing health promotion focus since the World Health Organization's 1986 Ottawa Charter. While schools, cities, and prisons have implemented this approach, its development within sports environments is recent. Sports are a popular leisure-time activity, requiring validated tools to measure health…

Based on the framework of testlet models, the current study suggests the Bayesian random block item response theory (BRB IRT) model to fit forced-choice formats where an item block is composed of three or more items. To account for local dependence among items within a block, the BRB IRT model incorporated a random block effect into the response…

The objectives of this study were to investigate the cognitive Bloom's taxonomy levels achieved in an introductory reinforced concrete design course, determine if the Bloom's levels assigned to the same exam questions by different professors varied, characterize student performance in relation to Bloom's levels, and quantify the Bloom's level…