Objective To develop an online discrete choice experiment (DCE) to elicit preferences for the format and content of tobacco treatment and determine the feasibility of the survey in face-to-face online interviews among college students. format content Participants A convenience sample of 28 college students. Methods A pilot online DCE survey with…

In line with the widespread proliferation of digital technology in everyday life, many countries are now beginning to use computer-based exams (CBEs) in their post-primary education systems. To ensure that these CBEs are delivered in a manner that preserves their fairness, validity, utility and credibility, several factors pertaining to their…

Artificial intelligence (AI) technologies have the potential to reduce the workload for the second language (L2) teachers and test developers. We propose two AI distractor-generating methods for creating Chinese vocabulary items: semantic similarity and visual similarity. Semantic similarity refers to antonyms and synonyms, while visual similarity…

This article considers the design process for new formative history assessments. Over the course of 3 years, my colleagues from the Stanford History Education Group and I designed, piloted, and revised dozens of "History Assessments of Thinking" (HATs). As we created HATs, we sought to gather information about their cognitive validity,…

In developing alternate assessments based on modified academic achievement standards (AA-MAS), several states have modified existing test items with the aim of enhancing accessibility and reducing difficulty for students with disabilities. Using Grade 8 multiple-choice test items in unmodified and modified forms, two studies examined student…

A study was conducted to determine whether competently reasoning clinicians (clinical instructors in medical instruction) could identify reasons competently reasoning students would eliminate distractors, and explain how students would reason to select the keyed response when solving multiple-choice items. The think-aloud protocols of clinicians…

Many current efforts to develop large-scale science assessments involve hands-on tasks because of their presumed power to elicit and measure scientific reasoning skills. An analysis of the processes in which students engage while responding to such assessment is needed in order to discover the specific forms of reasoning that tasks elicit. This…