The Mineralogy Concept Inventory (MCI) is a statistically validated 18-question assessment that can be used to measure learning gains in introductory mineralogy courses. Development of the MCI was an iterative process involving expert consultation, student interviews, assessment deployment, and statistical analysis. Experts at the two universities…

While research on online tests in higher education is steadily growing, there is little evidence in the literature of the use of learning management systems (LMS), such as Blackboard™, as rich sources of data on online tests practices. This paper reports on an investigation that used data from Blackboard™ LMS to gain insight into the purpose for…

In physics education, assessments address various forms of scientific knowledge. Most of the existing test instruments emphasise the assessment of content knowledge. These tests fail to measure the epistemic aspects of science. Thus, assessing epistemic knowledge is a theme that demands investigation. This study applies Rasch analysis to help…

High Order Thinking Skills (HOTS) are a significant part of the implementation of the 2013 Curriculum to develop student competencies in the 21st century. Not only in the context of learning are HOTS considered important. They contribute to the National Examination held in Indonesia, so careful preparation for this exam is needed. Chemistry has…

Item nonresponses are prevalent in standardized testing. They happen either when students fail to reach the end of a test due to a time limit or quitting, or when students choose to omit some items strategically. Oftentimes, item nonresponses are nonrandom, and hence, the missing data mechanism needs to be properly modeled. In this paper, we…

Settings-based approaches have become an increasing health promotion focus since the World Health Organization's 1986 Ottawa Charter. While schools, cities, and prisons have implemented this approach, its development within sports environments is recent. Sports are a popular leisure-time activity, requiring validated tools to measure health…

Based on the framework of testlet models, the current study suggests the Bayesian random block item response theory (BRB IRT) model to fit forced-choice formats where an item block is composed of three or more items. To account for local dependence among items within a block, the BRB IRT model incorporated a random block effect into the response…

The objectives of this study were to investigate the cognitive Bloom's taxonomy levels achieved in an introductory reinforced concrete design course, determine if the Bloom's levels assigned to the same exam questions by different professors varied, characterize student performance in relation to Bloom's levels, and quantify the Bloom's level…

In 2018, the National Center for Education Statistics (NCES) administered two assessments--the National Assessment of Educational Progress (NAEP) Technology and Engineering Literacy (TEL) assessment and the International Computer and Information Literacy Study (ICILS)--to two separate nationally representative samples of 8th-grade students in the…

Issues of intelligibility may arise amongst English learners when acquiring new words and phrases in North American academic settings, perhaps in part due to limited linguistic data available to the learner for understanding language use patterns. To this end, this paper examines the effects of Data-Driven Learning for Pronunciation (DDLfP) on…

Since 2000, the PISA test implemented by OECD has become the prime benchmark for international comparisons in education. The 2015 PISA edition introduced methodological changes that altered the nature of its results. PISA made no longer valid non-reached items of the final part of the test, assuming that those unanswered questions were more a…

Assessment is a topic that continues to be developed in science education research. Assessment evaluates not only students' cognitive abilities but also their thinking skills. Therefore, in this study, an assessment that could measure students' chemical literacy was developed. Chemical literacy is a thinking skill that students must develop as…

The use of computer-based tests (CBTs), for both formative and summative purposes, has greatly increased over the past years. One major advantage of CBTs is the easy integration of multimedia. It is unclear, though, how to design such CBT environments with multimedia. The purpose of the current study was to examine whether guidelines for designing…

Weighted least squares (WLS), weighted least squares mean-and-variance-adjusted (WLSMV), unweighted least squares mean-and-variance-adjusted (ULSMV), maximum likelihood (ML), robust maximum likelihood (MLR) and Bayesian estimation methods were compared in mixed item response type data via Monte Carlo simulation. The percentage of polytomous items,…

Testlets have advantages such as making it possible to measure higher-order thinking skills and saving time, which are accepted in the literature. For this reason, they have often been preferred in many implementations from in-class assessments to large-scale assessments. Because of increased usage of testlets, the following questions are…