Evidence of the internal consistency of standard-setting judgments is a critical part of the validity argument for tests used to make classification decisions. The bookmark standard-setting procedure is a popular approach to establishing performance standards, but there is relatively little research that reflects on the internal consistency of the…

One commonly used compromise standard-setting method is the Beuk (1984) method. A key assumption of the Beuk method is that the emphasis given to the pass rate and the percent correct ratings should be proportional to the extent that the panelists agree on their ratings. However, whether the slope of Beuk line reflects the emphasis that panelists…

The purpose of this study was to compare 12 commonly-used nonoverlap methods with each other and with the results of visual analysis. Data were obtained from 25 studies focused on embedded instruction and schema-based instruction and included a total of 101 graphs. Treatment effect estimates using 12 nonoverlap methods were calculated for each…

This article compares cut scores from two variations of the Hofstee and Beuk methods, which determine cut scores by resolving inconsistencies in panelists' judgments about cut scores and pass rates, with the Angoff method. The first variation uses responses to the Hofstee and Beuk percentage correct and pass rate questions to calculate cut scores.…

We reflect on the limitations of our research group's prior methods for assessing covariational reasoning which primarily used graphical tasks found in extant literature. Graphical tasks dominate the literature on covariational reasoning, and through our use of these tasks we came to question the heavy reliance on them. Our concerns led us to ask…

The RARE Model (Clucas Leaderman & Polychronopoulos, 2019) is a framework for nurturing collaborative relationships in assessment practice. The four components (R- relate, A- acknowledge, R- reflect, E- Empower), which are based in humanistic and postmodern counseling theories, outline interpersonal strategies to support and strengthen…

Because of the diversity and complexity of deaf-blindness, the task of assessment is "best approached with the mindset that you are engaged in a process of discovery" (Rowland, 2009). It incorporates a variety of methods including observation, interviews with people who know a child well, evaluations by specialists, and direct…

Assessing test dimensionality is a fundamental part of the evaluation of a test and a prerequisite for using item response theory models. The purpose of this study was to investigate how popular dimensionality assessment methods perform under some nonstandard and commonly encountered suboptimal conditions when the items are dichotomously scored.…

Although peer review has been widely used for formative assessment in writing instruction, there remain concerns about whether assessors are at a sufficient writing performance level that would allow them to identify major problems in the reviewed work and provide helpful feedback to improve draft quality. Little empirical research has examined…

Propensity score matching and weighting methods are applied to balance covariates and reduce selection bias in the analysis of observational study data, and ultimately estimate a treatment effect. We wish to evaluate the impact of a Supplemental Instruction (SI) program on student success in an Introductory Statistics course. In such student…

We surveyed early childhood personnel in the U.S. state of Colorado to explore reported practices during the initial evaluation of young children for early intervention or preschool special education. One hundred early childhood personnel participated. Overall, reported evaluation practices and processes matched recommended practices and met legal…

Creativity is a fundamental human accomplishment from scientific advances to composing music. The left dorsolateral prefrontal cortex (DLPFC) and inferior frontal gyrus (IFG) are important metacontrol hubs in flexibility and persistence brain states, respectively. Those hubs are related to divergent thinking, insight problem-solving, and…

Teacher agency is a pivotal element of professionalism and second/foreign language (L2) education. However, its role in L2 assessment has remained under-researched. Part of this negligence is due to the absence of a validated questionnaire to measure the construct and its underlying components. To address this gap, drawing on the ecological…

This study aimed to determine the perceptions of preservice elementary mathematics teachers about creating and evaluating real-life connections in story problems. The study was conducted according to the case design. The study group consists of 35 preservice teachers taking Mathematical Connection Teaching course. Study instruction was used as a…

This study aims to investigate the curriculum literacy levels of primary teachers. The study group of this study, which is based on a case study from qualitative research designs, consists of teachers working in primary schools in the 1st term of the 2020-2021 academic year in Diyarbakir. The teachers in the study group were selected by criterion…