We study the returns to experience in teaching, estimated using supervisor ratings from classroom observations. We describe the assumptions required to interpret changes in observation ratings over time as the causal effect of experience on performance. We compare two difference-in-differences strategies: the two-way fixed effects estimator common…

The benefits of peer evaluation of teaching effectiveness and quality in higher education are well documented. While instruments exist for the review and evaluation of entire online courses, there is no standardized single-lesson, peer evaluation instrument available for online instruction. This pilot study focused on the validation of a peer…

Complex competences, such as managing students' aggressive behaviour, are challenging to develop during teacher training. Recently, video-based simulations have been considered promising, yet suitable assessment instruments are limitedly available. This paper reports on the design and evaluation of a video-based assessment tool tailored to measure…

Students are assessed by coursework and/or exams, all of which are marked by assessors (markers). Student and marker performances are then subject to end-of-session board of examiner handling and analysis. This occurs annually and is the basis for evaluating students but also the wider learning and teaching efficiency of an academic institution.…

Authentic assessments are seen as a promising response to many of the challenges currently facing Higher Education. Studies have identified shared characteristics of authentic assessments, but it is also argued that the term is vague and subjective. Drawing on existing frameworks we have established a standardised measure to evaluate authenticity…

Scoring high-dimensional assessments (e.g., > 15 traits) can be a challenging task. This paper introduces the multilabel neural network (MNN) as a scoring method for high-dimensional assessments. Additionally, it demonstrates how MNN can score the same test responses to maximize different performance metrics, such as accuracy, recall, or…

Purpose: This research aims to construct an Evaluation Scale for Vocational Education Internships (ESVEI) tailored to assess the vocational educational internship experiences from the perspectives of vocational students. It also seeks to investigate the influence of certain factors -- such as gender, family background, educational attainment,…

Curated undergraduate research experiences have been widely used at colleges and universities for decades to build student interest, technical preparation, and confidence in the pursuit of scientific careers. Educators often employ standardized survey instruments to evaluate learning outcomes for research experiences, but many of these assessments…

This study aims to produce a more personalized recommendation system for online learning using multicriteria in collaborative filtering and data from the Binus Online Learning repository as a knowledge base. The study uses forecasting (regression) and consists of three stages: (1) collecting data on the results of the learning process; (2) adding…

Scientific inquiry ability is closely related to the process of hands-on inquiry practice. However, its assessment is often separated from this practice due to the limitation of technical basis and labor cost. The development of multimodal data analysis provides a new opportunity to realize automated assessment based on hands-on practice.…

Groupwork is a crucial aspect of work contexts and a key twenty first century skill. Assessment of groupwork provides a persistent challenge for educators in university contexts with students reporting experiences of unfairness from their peers during groupwork. This study developed a novel Peer Assessment Fairness Instrument to explore factors…