How can we test whether state-of-the-art generative models, such as Blender and GPT-3, are good AI teachers, capable of replying to a student in an educational dialogue? Designing an AI teacher test is challenging: although evaluation methods are much-needed, there is no off-the-shelf solution to measuring pedagogical ability. This paper reports…

This study analyzed the effect that shifts in the U.S. News & World Report rankings have on input variables such as admitting grade point average (GPA), percentage of students taking the Graduate Management Admissions Test (GMAT), average incoming GMAT score, acceptance rate, tuition rates, average student debt, the proportion of students with…

As students' reading proficiency gaps persist across the United States, educational leaders have turned to alternative methods to foster effective instructional literacy practices. One approach to combat this dilemma is the implementation of scripted reading programs. The purpose of the study was to investigate the impact of scripted reading…

The National Center for Education Statistics (NCES) conducted a special administration of the National Assessment of Educational Progress (NAEP) long-term trend (LTT) reading and mathematics assessments for age 9 students in 2022 to examine the impact of the COVID-19 pandemic on student learning. This brief document highlights the score declines…

The purpose of this research was to examine the relationship between State of Texas Assessments of Academic Readiness (STAAR) reading and academic progress in the programs of Istation and Star Renaissance (Star Ren) in fourth grade special education students. Special education students in the selected school district appear to produce inconsistent…

Many school districts in the United States are facing growing concerns regarding the shortage of qualified candidates for teaching positions. This problem has existed for some time, and its deleterious effects are exacerbated in school districts that have significant teacher turnover. School districts with higher teacher retention can mitigate…

This paper presents evidence confirming the validity of the RD design in the Reading Recovery study by examining the ability of the RD design to replicate the 1st grade results observed in the original i3 RCT focused on short-term impacts. Over 1,800 schools participated in the RD study over all four cohort years. The RD design used cutoff-based…

The study examines the effects of using computer delivered Processing Instruction (PI) to teach English reflexives. Thirty intermediate ESL learners participated in the pretest-treatment-posttest study. Participants received the input-based PI activities. Gains were assessed by traditional offline tasks such as sentence interpretation and…

Value-added assessment is designed to measure teacher contributions to student achievement in order to promote effective teaching (Battelle for Kids, 2011b; Darling-Hammond et al., 2012; Lee, 2011). When value-added assessment is used, research indicates that in some cases effective teaching is promoted, but in other cases it is not…

Because high-stakes testing for school accountability does not begin until third grade, accountability ratings for elementary schools do not directly measure students' academic progress in grades K through 2. While it is possible that children's test scores in grades 3 and above are highly correlated with children's outcomes in the untested…

For a certification, licensure, or placement exam, allowing examinees to take multiple attempts at the test could effectively change the pass rate. Change in the pass rate can occur without any change in the underlying latent trait, and can be an artifact of multiple attempts and imperfect reliability of the test. By deriving formulae to compute…

Purpose: There is a need for well-defined language phenotypes suitable for adolescents in twin studies and other large-scale research projects. Rice, Hoffman, and Wexler (2009) have developed a grammatical judgment measure as a clinical marker of language impairment, which has an extended developmental range to adolescence. Method: We conducted…

This article examines the implications of argument-based validity for the continued development of dynamic assessment (DA) research and practice. We propose that the move toward validation as a process of interpretation and evidence-based argument is commensurable with DA but that fundamental ontological differences with conventional approaches to…

Raters must score accurately and consistently for classroom observation scores to be valid. This requires (a) a standard defining when scoring is accurate and consistent enough and (b) measuring and remediating rater performance against that standard. Current practice has focused on this second problem to the exclusion of the first. My goal here…

To reduce test-taking anxiety among businesses students, a Paired Adaptive Test (PAT) system was developed that allows students two chances to answer exam questions. In the study 46 students from three sections of Survey of International Business at Utah Valley University were given exams using the PAT. At the end of the semester, students were…