The Reading the Mind in the Eyes Test (RMET) is a purported theory of mind measure and one that reliably differentiates autistic and non-autistic individuals. However, concerns have been raised about the validity of the measure, with some researchers suggesting that the multiple-choice format of the RMET makes it susceptible to the undue influence…

Evidence suggests that active engagement with material as it is being taught improves learning. In-class multiple choice questions are a common way to introduce active learning. Low-stakes writing is another. The author of this article provides evidence that using a content-based low-stakes writing prompt with immediate group feedback during the…

Multiple choice results are inherently probabilistic outcomes, as correct responses reflect a combination of knowledge and guessing, while incorrect responses additionally reflect blunder, a confidently committed mistake. To objectively resolve knowledge from responses in an MC test structure, we evaluated probabilistic models that explicitly…

There is a broad literature in multiple-choice test development, both in terms of item-writing guidelines, and psychometric functionality as a measurement tool. However, most of the published literature concerns multiple-choice testing in the context of expert-designed high-stakes standardized assessments, with little attention being paid to the…

The development and evaluation of valid assessments of scientific reasoning are an integral part of research in science education. In the present study, we used the linear logistic test model (LLTM) to analyze how item features related to text complexity and the presence of visual representations influence the overall item difficulty of an…

The arrangement of response options in multiple-choice (MC) items, especially the location of the most attractive distractor, is considered critical in constructing high-quality MC items. In the current study, a sample of 496 undergraduate students taking an educational assessment course was given three test forms consisting of the same items but…

Fifth-grade students watched a short video and then responded to multiple-choice items, including several without correct answers. Based on computer-supported stimulated recall and semi-structured interviews, we tested three common assumptions about what students are thinking when they respond to multiple-choice items in spite of being uncertain…

Learning objectives (LOs) are statements that typically precede a study session and describe the knowledge students should obtain by the end of the session. Despite their widespread use, limited research has investigated the effect of LOs on learning. In three laboratory experiments, we examined the extent to which LOs improve retention of…

Learning management systems (LMS) allow for a variety of ways in which online multiple-choice assessments ("tests") can be configured, including the ability to allow for multiple attempts and options for which of and how the attempts will count. These options are usually chosen according to the instinct of the instructor; however, LMS…

This study was conducted in the province of Québec, Canada, among French-speaking Grade 6 students (n = 175) in the context of a school curriculum that does not clearly address text structure and main idea instruction. It aims to understand whether these students can identify informative text structures and main ideas in isolated paragraphs,…

Students, as well as teachers, often learn what makes sense to them, even when it is wrong. These misconceptions are a problem. The authors sought a quick, quantitative way of identifying student misconceptions in secondary science. Using the University of Toronto's National Biology Competition test data, this article presents a method of quickly…

Active learning techniques, such as peer instruction and group work, have been gaining a lot of traction in universities. Taking a natural next step in re-evaluating current practices, many institutions recently started experimenting student-centred group exams. In order to assess the feasibility and effectiveness of collaborative assessments, we…

Graded Response Method (GRM) is an alternative to multiple-choice testing where students rank options according to their relevance to the question. GRM requires discrimination and inference between statements and is a cost-effective critical thinking assessment in large courses where open-ended answers are not feasible. This study examined…

This study investigated how studying a refutational map, a type of argument map, affected conceptual change. Refutational maps visually display both correct and alternative conceptions. Participants (N = 120) were randomly assigned to (1) a refutational map condition, (2) a refutational text condition, and (3) a non-refutational text condition.…

Several standardized and validated information literacy (IL) tests have been developed for use in U.S. post-secondary contexts, but fewer choices exist for schools outside of the U.S. In an earlier study (Cowan, Graham, & Eva, 2016) the authors explored IL testing at a Canadian university using the international version of the SAILS Cohort…