The background of this article is an interest in analysing how assessment of professional skills is conducted in higher education contexts, drawing on video data from a course on maritime navigation. The empirical study focuses on a) how students working in a bridge simulator are able to display their knowledge about how to calculate the relation…

In this article, we focus on a set of remote activities regarding simulated juries, judges' evaluations, communication of verdicts, and a post-discussion conversation. These activities aimed to promote learning of the preservice teachers about the differences between remote and in-person teaching in a chemistry teaching methods course. The set of…

Evaluation professionals need to be nimble and innovative in their approaches in order to be relevant and provide useful evidence to decision-makers, stakeholders, and society in the crowded public policy landscape. In this article, we offer serious games as a method that can be employed by evaluators to address three persisting challenges in…

The New Haven Local Section of the American Chemical Society held a virtual version of its annual Student Research Symposium prompted by the COVID-19 pandemic. A combination of YouTube, Google Drive, Open Broadcaster Software, and Zoom was utilized to hold the symposium which included juried oral and poster presentations. While our aim was to…

This study aimed to develop, validate, and trial a rubric for evaluating the cloud-based learning designs (CBLD) that were developed by teachers using virtual learning environments. The rubric was developed using the technological pedagogical content knowledge (TPACK) framework, with rubric development including content and expert validation of…

Ten secondary schools in a large state-wide education system initiated a virtual school network to address the lack of upper secondary school courses for university entry in smaller high schools. This article highlights the yearlong professional learning program designed to prepare a cohort of classroom teachers, who were novices to teaching…

This paper provides a two-phase study to compare alternative techniques for augmenting landscape scenes on geography fieldtrips. The techniques were: a pre-prepared acetate overlay; a custom-designed mobile field guide; a locative media app on a smartphone; a virtual globe on a tablet PC; a head-mounted virtual reality display, and a geo-wand…

The emergence of computer technology in English language teaching has paved the way for teachers' application of Mobile Assisted Language Learning (mall) and its advantages in teaching. This study aimed to compare the effectiveness of the face to face instruction with Telegram mobile instruction. Based on a toefl test, 60 English foreign language…

Several methods for determining a passing score on an examination from individual raters' estimates of minimal pass levels were compared through simulation. The methods used differed in the weighting estimates for each item received in the aggregation process. Reasons why the simplest procedure is most preferred are discussed. (SLD)

Describes an automated scoring algorithm for a computer-based simulation examination of physicians' patient-management skills. Results with 280 medical students show that scores produced using this algorithm are highly correlated to actual clinician ratings. Scores were also effective in discriminating between case performance judged passing or…

The effectiveness of alternative procedures to correct for rater leniency/stringency effects was studied when true scores were known. Ordinary least squares, weighted least squares, and imputation of the missing data consistently outperformed averaging the observed ratings; and the imputation technique was superior to the least squares methods.…

Performance rating systems frequently use multiple raters in order to improve the reliability of ratings. However, unless all candidates are rated by the same raters, some candidates will be at an unfair advantage or disadvantage solely because they were rated by more stringent or lenient raters. To obtain fair and accurate evaluations of…