Existing approaches to measuring writing performance are insufficient in terms of both technical adequacy as well as feasibility for use as a screening measure. This study examined the validity and diagnostic accuracy of several approaches to automated text evaluation as well as written expression curriculum-based measurement (WE-CBM) to determine…

KR-21 reliability and its extension (coefficient [alpha]) gives the reliability estimate of test scores under the assumption of tau-equivalent forms. KR-21 reliability gives the reliability estimate for summed scores for dichotomous items when items are randomly sampled from an infinite pool of similar items (randomly parallel forms). The article…

Rubrics are often used as tools for criteria-based assessments. Although students indicate that they appreciate comments given as feedback which make reference to the rubric and provided in addition to it, there is little information on how this type of feedback actually differs from in-text comments with respect to focus, level, and function of…

Scoring procedures for the constructed-response (CR) items in large-scale mixed-format educational assessments often involve checks for rater agreement or rater reliability. Although these analyses are important, researchers have documented rater effects that persist despite rater training and that are not always detected in rater agreement and…

Compared to other content areas, there is a dearth of research examining curriculum-based measurement of writing (CBM-W). This study conducted a conceptual replication examining the reliability, stability, and sensitivity to growth of slopes produced from CBM-W. Eighty-nine (N = 89) eighth-grade students responded to one CBM-W probe weekly for 11…

Machine learning (ML) has been increasingly employed in science assessment to facilitate automatic scoring efforts, although with varying degrees of success (i.e., magnitudes of machine-human score agreements [MHAs]). Little work has empirically examined the factors that impact MHA disparities in this growing field, thus constraining the…

This paper presents the assessment of a continuous assessment in a project for the Dynamics subject using an analytic rubric. Dynamics subject should improve the ability of students to evaluate and solve problems using well-understood basic concepts implemented in a simple logical manner. It focuses on the proper interpretation and application of…

In automated essay scoring (AES), scores are automatically assigned to essays as an alternative to grading by humans. Traditional AES typically relies on handcrafted features, whereas recent studies have proposed AES models based on deep neural networks to obviate the need for feature engineering. Those AES models generally require training on a…

We examined the extent to which automated written expression curriculum-based measurement (aWE-CBM) can be accurately used to computer score student writing samples for screening and progress monitoring. Students (n = 174) with learning difficulties in Grades 1 to 12 who received 1:1 academic tutoring through a community-based organization…

Evidence-based interventions are the standard for school psychology practice. Yet, how do professionals know when research scope, relevance, transparency, and quality are ready for real-world application? There remain questions as to exactly how these core concepts of evidence-based practices (EBPs) are realized. A discussion on whether…

Training art therapists requires fair grading systems that equitably assess learning styles and developmental levels of academic aptitude, particularly with longer term art assignments. As students progress in their studies, a contemplative education framework offers a self-directed learning environment that strives to share grading…

Existing approaches to measuring writing performance are insufficient in terms of both technical adequacy as well as feasibility for use as a screening measure. This study examined the validity and diagnostic accuracy of several approaches to automated text evaluation as well as written expression curriculum-based measurement (WE-CBM) to determine…

We examined the extent to which automated written expression curriculum-based measurement (aWE-CBM) can be accurately used to computer score student writing samples for screening and progress monitoring. Students (n = 174) with learning difficulties in Grades 1-12 who received 1:1 academic tutoring through a community-based organization completed…

Psychometricians at an organization named the Education and Training Evaluation Commission (ETEC) developed a new test scoring method called the latent D-scoring method (DSM-L) where it is believed that the new method itself is much easier and more efficient to use compared to the Item Response Theory (IRT) method. However, there are no studies…

This study examined community college full-time faculty members' perceptions of grading and reporting student learning via course grades using a mixed methods approach. The research questions that guided this study asked about the differences that exist in community college full-time faculty members' perceptions of grading by different academic…