Multi-angle question answering models have recently been proposed that promise to perform related tasks like question generation. However, performance on related tasks has not been thoroughly studied. We investigate a leading model called Macaw on the task of multiple choice question generation and evaluate its performance on three angles that…

Tools that assess school supports for highly mobile, military-connected students are lacking. This study describes the development and preliminary validation of the Inventory of School Supports-Parent Report (ISS-PR). Participants were 433 parents (74% female; 62.5% White, 12% Black, 6.5% Asian, 5.5% Pacific Islander, 4% Native American, and 9.5%…

Multiple choice questions are traditionally expensive to produce. Recent advances in large language models (LLMs) have led to fine-tuned LLMs that generate questions competitive with human-authored questions. However, the relative capabilities of ChatGPT-family models have not yet been established for this task. We present a carefully-controlled…

The purpose of this study was to examine the psychometric properties of the parent-report Short Form Positive Family Support Strengths and Needs Assessment (PFS-SaNA). The PFS-SaNA is designed to reduce the time and burden of collaborative mental health screening. Parents of 245 students in the Northwest completed the screener at third, fourth,…

Summative assessments provide data to evaluate the effectiveness of schools, teachers, and educational policies, contributing to a robust accountability system worldwide. However, educators and scholars argue that summative assessments do not effectively promote ongoing learning, enhance teaching practices, or align with the skills required in the…

While the measurement of treatment integrity is important to determine how much, and how well, interventions are delivered in schools, the science of treatment integrity is not well developed in education research. The purpose of this paper is to describe a program of research that has developed treatment integrity measures over the past 10 years…

Intervention research in education is sometimes criticized for the use of experimenter developed assessments, especially when these are over aligned with treatment. At the same time, intervention researchers sometimes prefer locally developed assessments because they appear to be more sensitive to treatment effects even when the test is not…

Background: Strategic implementation leadership is a critical determinant of successful implementation, hypothesized to create a more supportive implementation climate conducive to the adoption and use of evidence-based practices. Implementation leadership behaviors may vary significantly across contexts, necessitating studies that examine the…

To identify the most effective strategies for implementing and sustaining Tier 2 and 3 behavior support systems, a measure of general and tier-specific factors hypothesized to predict sustained implementation is needed. To address this need, we conducted two studies examining the construct validity of the "Advanced Level Tier Interventions…

When students require support to improve outcomes in a variety of domains, educators provide youth with school-based intervention. When educators require support to improve their professional practice, school leaders and support personnel (e.g., school psychologists) provide teachers with professional development (PD), consultation and coaching.…

This study investigated the technical characteristics of four early measurement curriculum-based measures (EM-CBMs) designed to assess concepts related to linear measurement and iteration. The sample consisted of 221 first grade students. Data were collected at two time points approximately 10 weeks apart. Reliability and concurrent and predictive…

Researchers strategically assess youth mental health by soliciting reports from multiple informants. Typically, these informants (e.g., parents, teachers, youth themselves) vary in the social contexts where they observe youth. Decades of research reveal that the most common data conditions produced with this approach consist of discrepancies…

Creativity is highly valued in both education and the workforce, but assessing and developing creativity can be difficult without psychometrically robust and affordable tools. The open-ended nature of creativity assessments has made them difficult to score, expensive, often imprecise, and therefore impractical for school- or district-wide use. To…

Effective classroom management is of critical importance to the success of universal, Tier I supports and services. Unfortunately, teacher-reported deficits in classroom management training are well documented. In response, use of professional development activities such as consultation, coaching, and on-going performance feedback emphasizing…

Measures of teacher mathematical knowledge are notoriously difficult to develop (e.g., Orrill et al., 2015). This is in part because of the multidimensional nature of teacher knowledge. As part of two separate projects being undertaken by this research team, we have attempted to write assessments of teacher pedagogical content knowledge (PCK) in…