Tests of statistical significance often play a decisive role in establishing the empirical warrant of evidence-based research in education. The results from pattern-based assessment items, as introduced in this paper, are categorical and multimodal and do not immediately support the use of measures of central tendency as typically related to…

This study quantified the orthographic knowledge (i.e., knowledge of spelling conventions) of school speech-language pathologists (SLPs). On average, SLPs (N = 48) answered 65% of the questions correctly on a measure of orthographic knowledge. SLPs need better preparation in written language structure to support reading acquisition in children…

A new diagnostic instrument, the Conceptual Survey on Wave Optics (CSWO), was developed and validated on 224 high school students (aged 18-19 years) in Croatia. The process of test construction, which included the testing of 61 items on the total of 712 students is presented. The final version of the test consists of 26 multiple-choice items which…

Research about repeated testing has revealed that retaking the same exam form generally does not advantage or disadvantage failing candidates in selected response-style credentialing exams. Feinberg, Raymond, and Haist (2015) found a contributing factor to this phenomenon: people answering items incorrectly on both attempts give the same incorrect…

We discuss a practical method for assessing mathematical proof online. We examine the use of faded worked examples and reading comprehension questions to understand proof. By breaking down a given proof, we formulate a checklist that can be used to generate comprehension questions which can be assessed automatically online. We then provide some…

Synthetically generated speech (SGS) has become an integral part of our oral communication in a wide variety of contexts. It can be generated instantly at a low cost and allows precise control over multiple aspects of output, all of which can be highly appealing to second language (L2) assessment developers who have traditionally relied upon human…

Unlike the traditional multiple-choice (MC) format, the discrete-option multiple-choice (DOMC) format does not necessarily reveal all answer options to an examinee. The purpose of this study was to determine whether the reduced exposure of item content affects test security. We conducted an experiment in which participants were allowed to view…

We employed qualitative research methods to examine student learning in context during a teacher's unit on 1920s-Great Depression in an 11th grade United States & Virginia History class in a standards-based setting with a high-stakes end-of-course test. We focused on four focal students (all of whom were classified as English learners at some…

A deep understanding of mechanical waves is crucial for students to succeed in studying many advanced physics topics. Studies in existing literature have revealed that students often have widespread difficulties and misconceptions on wave propagation. This research develops and applies a conceptual framework model to examine students'…

Methods of assessment in anatomy vary across medical schools in the United Kingdom (UK) and beyond; common methods include written, spotter, and oral assessment. However, there is limited research evaluating these methods in regards to student performance and perception. The National Undergraduate Neuroanatomy Competition (NUNC) is held annually…

This article explores the issue of identifying guessers -- with a specific focus on multiple-choice tests. Guessing has long been considered a problem due to the fact that it compromises validity. A test taker scoring higher than they should through guessing does not provide a picture of their actual ability. After an initial description of issues…

Eye-tracking technology can create a record of the location and duration of visual fixations as a test-taker reads test questions. Although the cognitive process the test-taker is using cannot be directly observed, eye-tracking data can support inferences about these unobserved cognitive processes. This type of information has the potential to…

The Assessment Resource Banks (ARBs) offer an innovative space to explore how responsive assessment for learning can work off- and online with Aotearoa New Zealand teaching and learning situations. They are a freely available online repository of formative assessment tasks that link to "The New Zealand Curriculum" (Ministry of Education,…

This study investigated the scalability of a cognitive multiple-choice test through the Mokken package in the R programming language for statistical computing. A 2019 mathematics West African Examinations Council (WAEC) instrument was used to gather data from randomly drawn K-12 participants (N = 2866; Male = 1232; Female = 1634; Mean age = 16.5…

The purpose of this study is two-fold: 1) to investigate the effects of Data-Driven Learning (DDL) framed within the Involvement Load Hypothesis (ILH) on Thai learners' use of academic collocations and 2) to examine how Thai learners utilized the involvement load (IL) components (need, search, and evaluation) to master academic collocations. It is…