Rubrics are popular tools to assess students' social-emotional skills. However, little research has been devoted to investigating whether rubrics' performance level descriptions validly represent the intended skills. In this study, we addressed the validity of Self-management rubrics by examining the presence of construct-irrelevant variance in…

Recent advances in automated writing evaluation have enabled educators to use automated writing quality scores to improve assessment feasibility. However, there has been limited investigation of bias for automated writing quality scores with students from diverse racial or ethnic backgrounds. The use of biased scores could contribute to…

When evaluating student learning, educators often employ scoring rubrics, for which quality can be determined through evaluating validity and reliability. This article discusses the norming process utilized in a graduate organizational leadership program for a capstone scoring rubric. Concepts of validity and reliability are discussed, as is the…

The research project assignment can create meaningful opportunities for students to apply sociological concepts. For grading these projects, assessment rubrics are useful pedagogical tools to evaluate students' abilities in achieving course learning objectives. In this study, I analyzed final research papers collected over multiple semesters in my…

How do examiners reach joint decisions when they grade oral examinations? While government and policymakers provide general frameworks about grading decisions, we know little about how they are actually accomplished in interaction, particularly when examiners initially disagree. We scrutinized 29 video-recorded grading conversations between…

This study analyzed Pennsylvania School Climate Survey data from students and staff in the 2021/22 school year to assess the validity and reliability of the elementary school student version of the survey; approaches to scoring the survey in individual schools at all grade levels; and perceptions of school climate across student, staff, and school…

While self-assessment is a widely explored area in educational research, our understanding of how students assess themselves, or in other words, generate self-feedback, is quite limited. Self-assessment process has been a black box that recent research is trying to open. This study explored and integrated two data collections (secondary and higher…

Learner-centered and inclusive and equitable teaching practices aim to promote better learning outcomes for all students. Course syllabi can provide a window into these practices. We adapted an existing rubric to measure inclusiveness and equity-mindedness of syllabi and used an established rubric to assess their learner-centeredness. We then…

In the context of formative assessment in classrooms, the incorporation of automated evaluation (AE) systems and teachers' interactions with them hold significant importance. This study aimed to investigate the cognitive processes of pre-service teachers as they engaged with an AE system. We developed an unsupervised learning-based AE system, the…

Effectively working in an engineering workplace requires strong teamwork skills, yet the existing literature within various disciplines reveals discrepancies in evaluating these skills. This complicates the design of a generic teamwork peer evaluation tool for engineering students. This study aims to address this gap by introducing the DRIVE…

When the purpose and meaning of grades is not well-defined by an organization, there is a disconnect between curricular/assessment practices and student engagement. This study sought to investigate origins and find solutions in regards to discerning a student's knowledge and mastery of a subject and how this is reflected in the grade, and how…

Topic models are mathematical and statistical models used to analyze textual data. The objective of topic models is to gain information about the latent semantic space of a set of related textual data. The semantic space of a set of textual data contains the relationship between documents and words and how they are used. Topic models are becoming…

School grades provide an easily understandable metric to measure the performance of a school. Parents and the general public can use the school grade and its associated components to understand how well each school is serving its students. The purpose of this technical guide is to provide a description of the procedures used to determine school…

This study examined the implementation of a multidisciplinary approach to teaching speaking and listening skills at St. Stephen's, a private 7th-12th grade school. Two teachers from non-English subjects participated in a six-week program to incorporate a common presentation framework and rubric developed by the English department. The study…

The Canadian Agility and Movement Skill Assessment (CAMSA) is a valid and reliable circuit-based test of motor competence which can be used to assess children's skills in a live or recorded performance and then coded. We aimed to analyze the intrarater reliability of the CAMSA scores (total, time, and skill score) and time measured, by comparing…