The National Leadership Council for Liberal Education, America's Promise (2007) proposed integrative learning as one of four areas of essential learning outcomes students should develop during their collegiate experience. Traditional assessment of integrative learning has focused on the evaluation of student work. In this study, we designed a pre-…

Meta-assessment is a useful strategy to document assessment practices and guide efforts to improve the culture of assessment at an institution. In this study, a meta-assessment of undergraduate and graduate academic program assessment reports evaluated the maturity of assessment work. Assessment reports submitted in the first year (75…

In many performance assessments, one or two raters from the complete rater pool scores each performance, resulting in a sparse rating design, where there are limited observations of each rater relative to the complete sample of students. Although sparse rating designs can be constructed to facilitate estimation of student achievement, the…

Teacher evaluations are routinely conducted across the United States for licensure and professional development supports. However, there is limited research on the interrater reliability of these evaluation assessment systems, despite federal recommendations (Graham et al., 2012). This research explores the systematic approach to interrater…

Although researchers have investigated technical adequacy and usability of written-expression curriculum-based measures (WE-CBM), the economic implications of different scoring approaches have largely been ignored. The absence of such knowledge can undermine the effective allocation of resources and lead to the adoption of suboptimal measures for…

The GEM Centre provides technical support to the United Nations Educational, Scientific and Cultural Organization (UNESCO) Institute for Statistics (UIS), which has been mandated to monitor the progress of countries towards achieving the education goals of Sustainable Development Goal 4 (SDG 4). The International Standard Setting Exercise (ISSE)…

In this Brief Report, we describe an evaluation of and revisions to a rubric adapted from the Jacobs et al.'s (1981) ESL COMPOSITION PROFILE, with four rubric categories and 20-point rating scales, in the context of an intensive English program writing placement test. Analysis of 4 years of rating data (2016-2021, including 434 essays) using…

Spatial skills are crucial to STEM disciplines and involve a variety of cognitive processes and skills related to visualising, reasoning and communicating about spatial relations. Particularly in the primary school years, attaining 'spatial literacy' gives children a valuable set of skills and knowledge that can aid them in successful…

Providing students with feedback on their performance is a critical part of enhancing student learning in chemistry and is often integrated into homework assignments, quizzes, and exams. However, not all feedback is created equal, and the type of feedback the student receives can dramatically alter the utility of the feedback to reinforce correct…

Automatic Speech Scoring (ASS) has increasingly become a useful tool in oral proficiency testing for Second Language (L2) learners. However, limited studies investigate the alignment of ASS indices with the Complexity, Accuracy, and Fluency (CAF)--the three dimensions in evaluating L2 speakers' oral proficiency, and the subsequent impact indices…

The Next Generation Science Standards regard biological structures at both the micro and macro levels as a core idea of life sciences and expect students to understand animals have external structures that perform diverse functions. Using the common creature of bees as a case, this study aimed to ascertain teenage students' ideas of bees through…

This study explores the feasibility of using AI technology, specifically ChatGPT-3, to provide reliable, meaningful, and personalized feedback. Specifically, the study explores the benefits and limitations of using AI-based feedback in language learning; the pedagogical frameworks that underpin the effective use of AI-based feedback; the…

The Survey of Physics Reasoning on Uncertainty Concepts in Experiments (SPRUCE) was designed to measure students' proficiency with measurement uncertainty concepts and practices across ten different assessment objectives to help facilitate the improvement of laboratory instruction focused on this important topic. To ensure the reliability and…

Classroom assessment is the process of documenting the knowledge, skills, attitudes and beliefs of learners. It provides essential feedback to both instructors and students to improve their teaching methods for guiding and motivating students to be actively involved in their learning. Assessment drives learning. Formative assessments enable the…

The same L2 speaking performance may be analysed and evaluated in very different ways by different teachers or raters. We present a new, technology-assisted research design which opens up to investigation the trajectories of convergence and divergence between raters. We tracked and recorded what different raters noticed when, whilst grading a…