The main goal of this study was to validate the strategy for the assessment of the cognitive complexity of chemical kinetics exam items. The strategy included three steps: 1) assessment of the difficulty of concepts, 2) assessment of distractor value, and 3) assessment of concepts' interactivity. One of the tasks was to determine whether there…

Digital automated assessment is a valuable and time-efficient tool for educators to provide immediate and objective feedback to learners. Automated assessment, however, puts high demands on the quality of the questions, alignment with the intended learning outcomes, and the quality of the feedback provided to the learners. We here describe the…

This study describes the role that Rasch measurement played in the development of assessments aligned to the "Next Generation Science Standards," tasks that require students to use the three dimensions of science practices, disciplinary core ideas and cross-cutting concepts to make sense of energy-related phenomena. A set of 27…

We previously (Gantt et al., 2023; Paoletti et al., 2021) identified items from the publicly released TIMSS 2011 assessments that had potential for students to employ covariational reasoning as a solution strategy. In this report, we explore the extent to which fourth-grade students' performance on such items in mathematics differed among 26…

Data literacy is crucial for adolescents to access and navigate data in today's technology-driven world. Researchers emphasize the need for K-12 students to attain data literacy. However, few available instructions have incorporated validated assessments. Therefore, I developed and implemented the Data literacy Assessment for Middle graders…

Over four semesters of a large introductory statistics course the authors found students were engaging in contract cheating on Chegg.com during multiple choice examinations. In this paper we describe our methodology for identifying, addressing and eventually eliminating cheating. We successfully identified 23 out of 25 students using a combination…

Much of the focus of international comparative studies of students' achievement has been on New Zealand students' falling standards. Using the most recent findings from the Trends in International Mathematics and Science Study (TIMSS), and, in particular, Year 9 New Zealand students' performance in specific items, this article suggests that there…

Purpose: The clinical assessment of intelligibility must be based on a large repository and extensive variation of test materials, to render test stimuli unpredictable and thereby avoid expectancies and familiarity effects in the listeners. At the same time, it is essential that test materials are systematically controlled for factors influencing…

In recent years, the interest in measuring growth in student ability in various subjects between different grades in school has increased. Therefore, good precision in the estimated growth is of importance. This paper aims to compare estimation methods and test designs when it comes to precision and bias of the estimated growth of mean ability…

This study examined assessment item difficulty patterns in two energy aspects, energy source/form/transfer and energy degradation/conservation, across and within science disciplines. The participant students were taking at least one college-level introductory science course. Findings showed a common pattern of item difficulties for the two energy…

The Mindset Assessment Profile is a popular questionnaire purportedly designed to measure mindset--an individual's belief in whether intelligence is malleable or stable. Despite its widespread use, the questionnaire appears to assess an individual's need for cognition and goal orientation more than mindset. We assessed the reliability, construct…

Purpose: The readability and comprehensibility of Learner's Permit Knowledge Test practice questions and the relationship with test failure rates across states and the District of Columbia were examined. Method: Failure rates were obtained from department representatives. Practice test questions were extracted from drivers' manuals and department…

Performance assessments (PAs) offer a more authentic measure of higher order skills, which is ideal for competency-based education (CBE) especially for students already in the workplace and striving to advance their careers. The goal of the current study was to examine the validity of undergraduate PA score interpretation in the college of IT at a…

Assessment of functional impairment provides information that is complementary to diagnostic criteria information and is critical for identifying targets for intervention and evaluating treatment outcomes. This review presents summative psychometric information for five multidimensional measures of functional impairment developed for use with…

This work is the fourth of a series of papers applying multidimensional item response theory (MIRT) to widely used physics conceptual assessments. This study applies MIRT analysis using both exploratory and confirmatory methods to the Brief Electricity and Magnetism Assessment (BEMA) to explore the assessment's structure and to determine a…