The Objective Structured Clinical Exam (OSCE) is a widely used method of assessment in medical education. Rater cognition has become an important area of inquiry in the medical education assessment literature generally, and in the OSCE literature specifically, because of concerns about potential compromises of validity. In this study, a novel…

The applied dissertation project focused on the development of a comprehensive onboarding program and Trainer's Guide specifically developed for charter school management employees. Charter school education has grown significantly in the last several decades with over 6,100 charter schools that are currently serving students nationwide. Formal or…

In our reflective essay from our multiple perspectives as journal editors, peer reviewers, and published authors, we present ideas about editorial support, democracy, and innovation in the publishing process. As four tenured professors who work in universities in the states of Illinois, Virginia, Texas, and Kentucky, we are a community of editors…

Call it innovation, creativity, imagination, cutting edge, paradigm shift, or any other term for new information, an assessment of innovation may now impact the final decision on awarding grants to investigators. What exactly is innovation and how does the reviewer perceive innovation in the research approach? Procedures, the approach, and…

Objective: Allowing psychiatric patients access to their electronic medical record (EMR) may cause difficulty related to the sensitivity of the note content. The authors investigated whether notes written by psychiatry trainees were ready for release to patients. Methods: Authors conducted a review of 128 PGY-3 to PGY-5 outpatient notes not…

High-quality training is a crucial investment in establishing and maintaining implementation fidelity as well as building educators' trust in the new process. Training approaches for educator evaluation vary both in format (i.e., how it's delivered) and content (i.e., what is provided). Train-the-trainer sessions, online professional learning…

The emergence of computer technology in English language teaching has paved the way for teachers' application of Mobile Assisted Language Learning (mall) and its advantages in teaching. This study aimed to compare the effectiveness of the face to face instruction with Telegram mobile instruction. Based on a toefl test, 60 English foreign language…

This article reports on a pedagogical project aimed at helping second language (L2) learners of English develop the ability to detect and appropriately interpret spoken sarcasm. The study used a pre- and posttest procedure to assess the development of learners' ability to both detect sarcasm and impute appropriate speaker intentions and attitudes…

Collegiate livestock judging is primarily an extracurricular activity that reinforces concepts taught in the classroom. Previous research has determined that participating on a livestock judging team can aid in the development of perceived life skills. Participants of this study indicated that their experience on a collegiate team helped them…

The current educational reform movement in the United States is focused on measuring the effectiveness of teachers. One component of teacher effectiveness is student achievement. The effectiveness of using PE Metrics as a measure of student achievement in a physical activity setting with a low socioeconomic, culturally diverse population was…

This paper investigates the performance of holistic and analytic scoring rubrics in the context of EFL writing. Specifically, the paper compares EFL students' scores on a writing task using holistic and analytic scoring rubrics. The data for the study was collected from 30 participants attending an English undergraduate program in a Yemeni…

By far, the most frequently used method of validating (the interpretation and use of) automated essay scores has been to compare them with scores awarded by human raters. Although this practice is questionable, human-machine agreement is still often regarded as the "gold standard." Our objective was to refine this model and apply it to…

Archived transcripts from tens of millions of online human tutoring sessions potentially contain important knowledge about how online tutors help, or fail to help, students learn. However, without ways of automatically analyzing these large corpora, any knowledge in this data will remain buried. One way to approach this issue is to train an…

This paper explores ways in which examiners, supervisors and others interpret the concept of "originality" when evaluating candidates' achievements in the final Ph.D. examination. It is based on institutional responses to a question in a 2006 discussion paper on doctoral assessment about how universities define originality for the…

Research on the relationship between English language proficiency standards and academic content standards serves to provide information about the extent to which English language learners (ELLs) are expected to encounter academic language use that facilitates their content learning, such as in mathematics and science. Standards-to-standards…