First-year seminars (FYS) comprise one of 11 researched interventions in postsecondary education known as High-Impact Practices, but few rigorous studies report significantly high impacts. This study examined a FYS employing propensity score matching to link cases and controls in a quasi-experimental design. One semester later cumulative grade…

We provide a novel characterization of augmented balancing weights, also known as automatic debiased machine learning (AutoDML). These popular "doubly robust" or "de-biased machine learning estimators" combine outcome modeling with balancing weights -- weights that achieve covariate balance directly in lieu of estimating and…

The large scale expansion of online courses has led to the crisis of course quality issues. In this study, we first established an evaluation index system for online courses using factor analysis, encompassing three key constructs: course resource construction, course implementation, and teaching effectiveness. Subsequently, we employed factor…

First impressions can influence rater-based judgments but their contribution to rater bias is unclear. Research suggests raters can overcome first impressions in experimental exam contexts with explicit first impressions, but these findings may not generalize to a workplace context with implicit first impressions. The study had two aims. First, to…

Well-designed academic interventions can give students the targeted support they need to build confidence, improve specific skills, and reach their full academic potential. This Spotlight will help you measure the connection between tutoring, attendance, and better test scores; identify effective practices for tutoring; learn how to simultaneously…

This study investigated the impact that co-curricular programming delivered by the University Honors Program (UHP) at North Carolina State University through the Honors Forum course had on first-year students' self-reported knowledge of civil discourse, their assessment of its importance and impact, and their evaluation of their commitment to the…

The Force Concept Inventory (FCI) is one of the research-based assessments established by the physics education research community to measure students' understanding of Newtonian mechanics. Former works have often recorded the notion of gendered mean FCI scores favoring male students notably in the North American (NA) based studies. Nevertheless,…

Background: Working and interacting with people from diverse backgrounds have become common in Engineering. Research has indicated that engineering graduates face challenges while working with a diverse workforce. Therefore, it is vital for higher education institutions to help engineering students develop intercultural competence skills by…

Equating is a statistical procedure used to adjust for the difference in form difficulty such that scores on those forms can be used and interpreted comparably. In practice, however, equating methods are often implemented without considering the extent to which two forms differ in difficulty. The study aims to examine the effect of the magnitude…

There is widespread concern about declining literacy skills in recent young Japanese. The present study investigated how higher-level reading and writing proficiencies are underpinned by basic literacy skills in Japanese adolescents. From a large database of the most popular literacy exams in Japan, we retrospectively analyzed word- and text-level…

Background: Teacher quality matters for student achievement (Coleman, 1968; Rivkin et al., 2005; Rockoff, 2004; Aaronson et al., 2007) and later career success (Chetty et al., 2014). States use licensure exams as a quality screen believing that they are predictive of teaching effectiveness (Council et al., 2001). However, the evidence on the…

This report provides advice to policymakers and school leaders on the use of assessment centres as part of a teacher selection approach. It discusses the relationship between assessment centre scores prior to joining teaching, and teacher effectiveness over a six-year period. It draws from various stages of a wider research project, the overall…

As students are exposed to extreme temperatures with ever-increasing frequency, it is important to understand how such exposure affects student learning. In this paper we draw upon detailed student achievement data, combined with high-resolution weather records, to paint a clear portrait of the effect of temperature on student learning across a…

The aims of this reliability generalization study were to provide the overall alpha values of the California critical thinking disposition inventory (CCTDI) total score and subscales scores and investigate the characteristics of the studies that may be associated with the variability in the reliability values of the CCTDI total score and subscales…

This dissertation was designed to foster a deeper understanding of population invariance in the context of composite-score equating and provide practitioners with guidelines for addressing score equity concerns at the composite score level. The purpose of this dissertation was threefold. The first was to compare different composite equating…