Through Many-Facet Rasch analysis, this study explores the rating differences between 1 computer automatic rater and 5 expert teacher raters on scoring 119 students in a computerized English listening-speaking test. Results indicate that both automatic and the teacher raters demonstrate good inter-rater reliability, though the automatic rater…

This paper arises from research undertaken by educational semioticians and science educators investigating the use of student generated digital artefacts as assessment tasks in pre-service science teacher education. Part of a broader shift toward student-generated media in tertiary science, the use of such tasks is driven by the need to deepen…

This report is an update of the assessment principles and guidelines for English language learners published in 2013 (Thurlow, Liu, Ward, & Christensen). That report, which was developed by the Improving the Validity of Assessment Results for English Language Learners with Disabilities (IVARED) project, presented essential principles of…

This book demonstrates how to address practical and ethical challenges when evaluating capacities of older adults with neurocognitive disorders, like dementia. The contributors are expert clinicians who draw upon real-life experiences conducting clinical capacity assessments in civil matters, illustrating best practices from the ABA/APA's…

The alignment between a test and the content domain it measures represents key evidence for the validation of test score inferences. Although procedures have been developed for evaluating the content alignment of linear tests, these procedures are not readily applicable to computerized adaptive tests (CATs), which require large item pools and do…

The use of single-case effect sizes (SCESs) has increased in the intervention literature. Meta-analyses based on single-case data have also increased in popularity. However, few researchers who have adopted these metrics have provided an adequate rationale for their selection. We review several important statistical assumptions that should be…

A major challenge faced by today's faculty developers is how to move beyond the perpetual use of simplistic program evaluation practices and adopt an approach that empowers faculty developers and administrators to implement a mission-based, result-oriented program evaluation model. This article reveals the five most common elements contributing to…

Creativity is increasingly viewed as an important 21st century skill that needs to be taught in schools. This emphasis on creativity is often reflected by having students engage in open-ended, project based activities and assignments. A key challenge faced by educators is how such assignments are to be evaluated. An in-depth review of existing…

Challenges in assessing the pain of children with special needs are created by the differing abilities of these students to self-report pain presence and intensity. This article reports the results of a literature review examining methods of pain assessment for children with special needs. The authors note the need to foster partnerships with…

For several decades members of the American Evaluation Association have discussed and disputed the issue of evaluator certification. Our past inability to agree on a certification solution may have been partially caused by the weaknesses of traditional certification systems, which rely on candidates obtaining a degree and completing a…

E-assessment is an umbrella term that comprises a complex array of tools of varying capacities. This paper focuses on the topic of e-assessment from the perspective of its strategic institutional development in higher education. The paper argues that research on e-assessment has been dominated by a focus on investigating benefits of use and…

Common Education Data Standards (CEDS) Version 4 introduced a common data vocabulary for defining rubrics in a data system. The CEDS elements support digital representations of both holistic and analytic rubrics. This document shares examples of holistic and analytic project rubrics, available CEDS Connections, and a logical model showing the…

The utility of teacher evaluation depends on meaningful teacher engagement with evaluation processes. However, critics of traditional tenure policies suggest that tenure nullifies teacher engagement with practices to improve performance. This study investigates whether tenured teachers exhibit perceptions that reflect disengagement with evaluation…

Early intervention (EI) teams can use Implementation Science to choose, implement, and sustain the use of evidence-based strategies and programs. Smith et al. (2014) described Implementation Science as "the study of the processes needed to bring new practices into widespread use" (p. 4). Programs work through four stages: exploration,…

The Strategic Universal Design for Learning Course Development (S-UDLCD™) Faculty & Institutional Evaluation System (2023) is a research-based framework for assessing faculty performance, enhancing student retention, and improving institutional effectiveness. Unlike traditional models, this system integrates predictive analytics, student…