New Meridian Corporation has developed the "Quality Testing Standards and Criteria for Comparability Claims" (QTS). The goal of the QTS is to provide guidance to states that are interested in including content from the New Meridian item bank and intend to make comparability claims with "other assessments" that include New…

Inference is considered an important factor in comprehension models and has been described as a causal factor in predicting comprehension. To date, specific tests for inference are rare and often rely on specific thematic texts. This reliance on thematic inference may raise some concerns as inference is related to prior text-specific knowledge.…

This study aimed to propose a new method for scoring C-Tests as measures of general language proficiency. In this approach, the unit of analysis is sentences rather than gaps or passages. That is, the gaps correctly reformulated in each sentence were aggregated as sentence score, and then each sentence was entered into the analysis as a polytomous…

Emergent writing--the process where young children begin to experiment with written language--is an important contributor to the development of literacy skills. One way for teachers to support the development of writing skills in preschool-aged children is by integrating the Classroom Assessment Scoring System (CLASS) as a framework to foster…

Hispanic-Serving Institutions (HSIs) play an important role in educating Latinos. The purpose of this article is to apply and extend the Typology of Hispanic-Serving Institutions Organizational Identities framework and propose a systematic rubric as a tool for assessment and evaluation. The article contains analyses and discourse for HSIs…

In the fairy tale "Goldilocks," a young girl enters the home of three bears. As she explores the porridge, chairs, and beds, in each situation she is seeking what is "just right." It seems that Goldilocks is the perfect metaphor for describing learners experiencing universal design for learning (UDL) because it highlights the…

Assessment methods vary widely across undergraduate physiology courses. Here, a cumulative oral examination was administered in two sections of a 300-level undergraduate physiology course. Student performance was quantified via instructor grading using a rubric, and self-perceptions (n = 55) were collected via survey. Overall, students affirmed…

Existing approaches to measuring writing performance are insufficient in terms of both technical adequacy as well as feasibility for use as a screening measure. This study examined the validity and diagnostic accuracy of several approaches to automated text evaluation as well as written expression curriculum-based measurement (WE-CBM) to determine…

KR-21 reliability and its extension (coefficient [alpha]) gives the reliability estimate of test scores under the assumption of tau-equivalent forms. KR-21 reliability gives the reliability estimate for summed scores for dichotomous items when items are randomly sampled from an infinite pool of similar items (randomly parallel forms). The article…

Rubrics are often used as tools for criteria-based assessments. Although students indicate that they appreciate comments given as feedback which make reference to the rubric and provided in addition to it, there is little information on how this type of feedback actually differs from in-text comments with respect to focus, level, and function of…

Scoring procedures for the constructed-response (CR) items in large-scale mixed-format educational assessments often involve checks for rater agreement or rater reliability. Although these analyses are important, researchers have documented rater effects that persist despite rater training and that are not always detected in rater agreement and…

Compared to other content areas, there is a dearth of research examining curriculum-based measurement of writing (CBM-W). This study conducted a conceptual replication examining the reliability, stability, and sensitivity to growth of slopes produced from CBM-W. Eighty-nine (N = 89) eighth-grade students responded to one CBM-W probe weekly for 11…

Machine learning (ML) has been increasingly employed in science assessment to facilitate automatic scoring efforts, although with varying degrees of success (i.e., magnitudes of machine-human score agreements [MHAs]). Little work has empirically examined the factors that impact MHA disparities in this growing field, thus constraining the…

This paper presents the assessment of a continuous assessment in a project for the Dynamics subject using an analytic rubric. Dynamics subject should improve the ability of students to evaluate and solve problems using well-understood basic concepts implemented in a simple logical manner. It focuses on the proper interpretation and application of…

In automated essay scoring (AES), scores are automatically assigned to essays as an alternative to grading by humans. Traditional AES typically relies on handcrafted features, whereas recent studies have proposed AES models based on deep neural networks to obviate the need for feature engineering. Those AES models generally require training on a…