Over the past ten years, propensity score methods have made an important contribution to improving generalizations from studies that do not select samples randomly from a population of inference. However, these methods require assumptions and recent work has considered the role of bounding approaches that provide a range of treatment impact…

Coaches require support to successfully navigate the integration of professional, interpersonal and intrapersonal knowledge to be effective within their environment. There is a need for coaches to have access to, and utilization of, a practical tool to identify and appraise elements of their coaching delivery. There is a wealth of literature on…

Students now have readily available and powerful tools to access, manipulate, combine, and visualize data. Acquiring data and visual literacy requires more than knowledge of how to use these tools. Students need to engage with assignments that challenge them to make relatively complex visualizations, interpret them, and explain why these…

Automated Essay Scoring (AES) technologies provide innovative solutions to score the written essays with a much shorter time span and at a fraction of the current cost. Traditionally, AES emphasized the importance of capturing the "coherence" of writing because abundant evidence indicated the connection between coherence and the overall…

The development and implementation of varied assessment practices is a major focus in higher education. Assessment benefits both students and teachers; it informs teachers about students' learning and misconceptions, thereby helping teachers improve teaching practices and students assess their current state of understanding. In general, the field…

One of the challenges of discussing validity arguments for machine scoring of essays centers on the absence of a commonly held definition and theory of good writing. At best, the algorithms attempt to measure select attributes of writing and calibrate them against human ratings with the goal of accurate prediction of scores for new essays.…

The study is the empirical application of Gul and Jamal's (2021) Transfer of Knowledge Index. The study presents the ranking of 17 public sector HEI by categorizing them into High, Medium, and Low transfer of knowledge activity HEI. In the process of ranking the HEI based on the transfer of knowledge, the study also highlights several issues that…

The validity of the Kappa coefficient of chance-corrected agreement has been questioned when the prevalence of specific rating scale categories is low and agreement between raters is high. The researchers proposed the Lambda Coefficient of Rater-Mediated Agreement as an alternative to Kappa to address these concerns. Lambda corrects for chance…

Multistage adaptive testing (MST) has become popular in the testing industry because the research has shown that it combines the advantages of both linear tests and item-level computer adaptive testing (CAT). The previous research efforts primarily focused on MST design issues such as panel design, module length, test length, distribution of test…

Background: Non-word repetition (NWR) tests are an important way speech and language therapists (SaLTs) assess language development. NWR tests are often scored whilst participants make their responses (i.e., in real time) in clinical and research reports (documented here via a secondary analysis of a published systematic review). Aims: The main…

To improve clinical teaching skills, feedback on teachers' strengths and weaknesses needs to be reliable, timely, and relevant. To provide timely feedback we undertook development of an analytical dashboard to provide learner feedback to our faculty. As dashboard data displays are limited we performed a modified Delphi (mDelphi) method to…

Computational thinking (CT) is a multidimensional term that encompasses a wide variety of problem-solving skills related to the field of computer science. Unfortunately, standardized, valid, and reliable methods to assess CT skills in preschool children are lacking, compromising the reliability of the results reported in CT interventions. To…

This study investigates the application of the fuzzy logic method for scoring open-ended items, specifically comparing its effectiveness against traditional scoring methods. Utilizing the fuzzy TOPSIS method within the mathematics domain, this research established seven criteria for evaluating open-ended responses, developed in consultation with…

How do we make judgements about the quality of online courses? Checklists and rubrics are commonplace in higher education for establishing and measuring design features of online courses. They are created and used by institutions, academics and educational designers to standardise measures for quality online course design. Despite an intensifying…

Despite their widespread adoption and recognised benefits, rubrics have been critiqued for their potential misalignment with student needs. The voices of international students, who constitute a substantial portion of the higher education population, remain underrepresented. This study examines the perspectives of international undergraduate…