The Discrete Option Multiple Choice (DOMC) item format was introduced by Foster and Miller (2009) with the intent of improving the security of test content. However, by changing the amount and order of the content presented, the test taking experience varies by test taker, thereby introducing potential fairness issues. In this paper we…

This article reviews a selected sample of 70 empirical studies in journal articles and doctoral dissertations on language assessment in China between 2011 and 2018. Following a brief introduction to the history and current state of language assessment in China, the article presents a critical review of language assessment research on six themes…

In 2017, the Office of Planning, Research, and Evaluation (OPRE) in the Administration for Children and Families (ACF) funded Mathematica to conduct the Infant and Toddler Teacher and Caregiver Competencies (ITTCC) project. The project aims to examine existing efforts across states, institutions of higher education, professional organizations, and…

This report, which is based on an invited presentation given at the 2015 meeting of the Association of Test Publishers, is a response to the continuing proliferation of scale linking studies that have occurred since the publication of "Uncommon Measures" in 1999.The report has four parts. First, I restate the conclusions made in…

We investigated the effect of retrieval practice (i.e., the use of testing to enhance learning) by middle school students on science learning in an authentic educational setting. For initial study, all students (n = 39) read a science text and made study notes about the text, a regular study activity in their course. For restudy (2 days later),…

Background: A clinical swallow examination (CSE) provides integral information that informs the diagnostic decision-making process within dysphagia management. However, multiple studies have highlighted a high degree of reported variability within the CSE process. It has been hypothesized that such variability may be the result of the clinical…

This article introduces ethnographic upscaling, an innovative procedure to explore and test hypotheses drawn from in-depth ethnographic findings in spatially continuous cases. The approach combines the strength of localized ethnographic descriptions with questionnaire-based regional surveys to study the distribution of ethnographic findings across…

Three examples of extant testing practices (i.e., a classroom instructor's use of a simple pre-post design, the practice of teaching to the test, and the think aloud verbal protocol) are discussed to illustrate the contention that assessment in the service of testing and learning does not necessarily involve radically different assessment…

The completion rates were compared for long-form questions where a large blank answer space is provided and for long-form questions where the answer space has bullet-points prompts corresponding to the parts of the question. It was found that students were more likely to complete a question when bullet points were provided in the answer space.…

The Wechsler Intelligence Scale for Children (WISC) is the most widely used intelligence test in the world. Now in its fifth edition, the WISC-V has been translated and adapted for use in nearly a dozen countries. Despite its popularity, numerous concerns have been raised about some of the procedures used to develop and validate translated and…

For assessment contexts where both a paper-based test and an on-screen assessment are available as alternatives, it is still common for the paper-based test to be prepared first with questions later transferred into an on-screen testing platform. One challenge with this is that some questions cannot be transferred. One solution might be for…

Large amounts of missing data could distort item parameter estimation and lead to biased ability estimates in educational assessments. Therefore, missing responses should be handled properly before estimating any parameters. In this study, two Monte Carlo simulation studies were conducted to compare the performance of four methods in handling…

Student preference for use of notes during test-taking, and performance outcomes with and without notes, is documented. While alleviating testing anxiety, usage of notes does little to affect testing outcomes, either positively or negatively. This study, undertaken across four semesters, both with and without use of a note sheet, finds no…

Wisdom, long a topic of interest to moral philosophers, is increasingly the focus of social science research. Philosophers have historically been concerned to develop a rationally defensible account of the nature of wisdom and its role in the moral life, often inspired in various ways by virtue theoretical accounts of practical wisdom…

Technology-based assessments that involve collaboration among students offer many sources of process data, although it remains unclear which aspects of these data are most meaningful for making inferences about students' collaborative skills. Recent research has focused mainly on theory-based rubrics for qualitative coding of process data (e.g.,…