Recent research seeks to develop more comprehensive learner models for adaptive learning software. For example, models of reading comprehension built using data from students' use of adaptive instructional software for mathematics have recently been developed. These models aim to deliver experiences that consider factors related to learning beyond…

Recent advances in automated writing evaluation have enabled educators to use automated writing quality scores to improve assessment feasibility. However, there has been limited investigation of bias for automated writing quality scores with students from diverse racial or ethnic backgrounds. The use of biased scores could contribute to…

Motivation for reading is important to comprehension and has been studied extensively in offline reading contexts. However, we know little about the role of motivation in online reading, a new and increasingly important context for reading. This is largely because we lack valid and reliable instruments to estimate a student's motivation for online…

The purpose of this study was to examine the psychometric properties of the parent-report Short Form Positive Family Support Strengths and Needs Assessment (PFS-SaNA). The PFS-SaNA is designed to reduce the time and burden of collaborative mental health screening. Parents of 245 students in the Northwest completed the screener at third, fourth,…

Response Process Validity (RPV) reflects the degree to which items are interpreted as intended by item developers. In this study, teacher responses to constructed response (CR) items to assess pedagogical content knowledge (PCK) of middle school mathematics teachers were evaluated to determine what types of teacher responses signaled weak RPV. We…

It is essential for items in assessments of mathematics' teacher knowledge to evoke the desired response processes -- to be interpreted and responded to by teachers as intended by item developers. In this study, we sought to unpack evidence that middle school mathematics teachers were not consistently interacting as intended with constructed…

Introduction: We report predictive validity of the newly defined Student Risk Screening Scale -- Internalizing and Externalizing (SRSS-IE 9, with 9 items) when used for the first time by middle and high school teachers from 43 schools. Methods: The sample included 11,773 middle school-aged students representing four geographic regions, and 7,244…

Organization, time management, and planning (OTMP) skills are behavioral manifestations of executive functioning linked to academic outcomes. Interventions to improve OTMP skills have shown favorable outcomes. The Children's Organizational Skills Scale parent and teacher forms (COSS-P, COSS-T) are widely used for assessing OTMP skills, but there…

Purpose: The aim of this study was to advance the analysis of written language transcripts by validating an automated scoring procedure using an automated open-access tool for calculating morphological complexity (MC) from written transcripts. Method: The MC of words in 146 written responses of students in fifth grade was assessed using two…

Purpose: Our study focused on identifying measurable constructs of a restorative classroom and appropriate metrics to measure those constructs through content validity analysis of a direct observation tool. The tool was designed to assess restorative practices implementation in the classroom in the context of professional development supporting…

Assessing students' conceptions related to independence of events and determining probabilities from a sample space has been the focus of research in probability education for over 40 years. While we know a lot from past studies about predictable ways students may reason with well-known tasks, developing a diagnostic assessment that can be used by…

As many as 1 in 5 youth in the United States experience social, emotional, and behavioral problems. However, many students with mental health concerns are unidentified and do not receive adequate care. The purpose of this study was to evaluate the factor structure, measurement invariance, and the concurrent and predictive validity of the Early…

Background: Technically sound measures are necessary for accurately identifying youth at risk for depression, but many studies rely on classical test theory metrics or adult samples to evaluate measures. This study examined the use of the PHQ-8, a common and freely available pediatric depression screener, in an adolescent sample using item…

Writing motivation is a multidimensional construct that has been demonstrated to be of great importance in writing performance and growth. Yet, much of the extant research has failed to examine the nuances of the various dimensions of writing motivation--in particular, task competency beliefs--and has neglected to investigate how the various…

Recent reviews of automated writing evaluation systems indicate lack of uniformity in the purpose, design, and assessment of such systems. Our work lies at the nexus of critical themes arising from these reviews. We describe our work on eRevise, an automated writing evaluation system focused on elementary students' text-based evidence-use. eRevise…