Content-based automated scoring has been applied in a variety of science domains. However, many prior applications involved simplified scoring rubrics without considering rubrics representing multiple levels of understanding. This study tested a concept-based scoring tool for content-based scoring, c-rater™, for four science items with rubrics…

Background: There is unrealized potential in higher education for greater use of performance assessment, particularly in support of teaching and learning: Well-designed performance tasks can elicit evidence regarding what students know and can do with respect to complex learning objectives. At the same time, there is some pressure, at least in the…

Effective teamwork is integral to the functioning of many professions. Employers desire work-ready graduates who have developed the so-called 'soft skills' involved in teamwork. One way for students to practise and gain feedback on their team skills is through team-based assessment tasks. The TeamUP Rubric was developed to teach and assess five…

This study aims to systematically evaluate the scoring errors made by psychologists in training, in the hopes of providing strong, empirically based guidelines to training programs. Survival analysis was used to determine the number of attempts required for graduate students to achieve proficiency in scoring standardized record forms from the…

This paper presents a case study of how librarians can situate themselves as pedagogical partners by bringing their unique information literacy perspective and expertise to the programmatic assessment process. This report resulted from the Thun Library and the Penn State Berks Composition Program's collaboration to assess the institution's…

Although there are many methods available for assessing text comprehension, the cloze test is not widely acknowledged as one of them. Critiques on cloze testing center on its supposedly limited ability to measure comprehension beyond the sentence. However, these critiques do not hold for all types of cloze tests; the particular configuration of a…

This study describes the development and initial psychometric evaluation of the Recognizing Effective Special Education Teachers (RESET) observation instrument. The study uses generalizability theory to compare two versions of a rubric, one with general descriptors of performance levels and one with item-specific descriptors of performance levels,…

The purpose of this study is to better understand the norms, processes, and implications of a standards-based assessment (SBA) system in a project-based, STEM-focused secondary school in the United States. The SBA system had both formative and summative components in relation to classroom teaching and grading, respectively. We focus on both…

Accounting instructors can embed effective writing into the curriculum, but how much instruction is enough to make a significant improvement in students' written products? In this quasi-experimental study, we compare the effect of three levels of minimal instructional intervention: all students in the study received a rubric outlining the…

This study set out to examine the range of legibility demonstrated by Western Australian students required to handwrite tasks of increasing intrinsic cognitive load. A representative sample of students in Years 1, 2 and 3 (N=437) was recruited for a cross sectional study and teachers administered handwriting tasks. Year 1 students were…

This study examined the scoring errors across three widely used achievement tests (Kaufman Test of Educational Achievement--Second Edition [KTEA-2], Woodcock--Johnson Tests of Achievement--Third Edition [WJ-III], and the Wechsler Individual Achievement Test--Third Edition [WIAT-III]) by novice examiners. A total of 114 protocols were evaluated for…

Evaluation of online instructors is a developing field of research. Institutions have made great progress in recent years to refine their efforts to evaluate online teaching in order to improve online teaching. Some institutions, however, still struggle to evaluate online instructors who did not design the course they are teaching. The purpose of…

In this study, it was aimed to examine the interrater reliability of the scoring of paragraph writing skills on foreign languages with the measurement invariance tests. The study group consists of 267 students studying English at the Preparatory School at Gazi University. In the study, where students write a paragraph on the same topic, the…

This article focuses on the validity of the new Narrative Reflection Assessment Rubric (NARRA) used to assess students' reflective narratives in higher education. We evaluate its formulation and usefulness from an instructional point of view. To those ends, we engage in both a quantitative and a qualitative analysis, using data from 100+…

Evidence suggests that facilitated interventions in study abroad enhance gains in intercultural development, but many recent studies are not generalizable due to small numbers and lack of experimental design. In this study, subjects received individual or small-group interventions online in a course with trained intercultural mentors. The authors…