Prior work has documented a substantial penalty associated with taking the Partnership for Assessment of Readiness for College and Careers (PARCC) online relative to on paper (Backes & Cowan, 2019). However, this penalty does not necessarily make online tests less useful. For example, it could be the case that computer literacy skills are…

In this article, we report on a mixed method study conducted through a previously validated bilingual instrument. The purpose was to understand elementary bilingual and dual language (BDL) teachers' perspectives of science and engineering (S&E) teaching in Massachusetts and Puerto Rico with the goal of developing situated professional…

Learning problems (LP) can have wider implications than the academic deficits per se. The goal of the present series of studies was to develop a reliable and valid quality-of-life measure targeted to children and adolescents with LP. In Study 1, using a 35-item questionnaire, we surveyed 151 parents/guardians of children referred for assessment of…

In this article, we highlight the need for a precisely defined construct in score-based validation and discuss the contribution of cognitive theories to accurately and comprehensively defining the construct. We propose a framework for integrating cognitively based theoretical and empirical evidence to specify and evaluate the construct. We apply…

This mixed methods study examines perspectives on failure in the classroom by elementary teachers new to teaching engineering. The study participants included 254 teachers in third, fourth, and fifth grade who responded to survey questions about failure, as well as a subset of 38 of those teachers who participated in interviews about failure. The…

Screening and monitoring student reading progress can be costly and time consuming. Assessment embedded within the context of online instructional programs can capture ongoing student performance data while limiting testing time outside of instruction. This paper presents two studies that examined the validity of using performance measures from a…

There is a paucity of evidence supporting the use of curriculum-based mathematics measures (M-CBMs) at the middle school level, which makes data-based decisions challenging for school professionals. The purpose of this study was to examine the relationships among three existing M-CBM indices: (a) basic facts, (b) concepts/application, and (c)…

The Assessment of Afterschool Program Practices Tool ("APT"), developed by the National Institute of Out-of-School Time (NIOST), is an observational instrument designed to measure the aspects of afterschool program quality that research suggests contribute to the 21st century skills, attitudes, and behaviors youth need to be successful…

This study investigated the relationship between emotional responses and reading performance in middle-school students. Although a large number of prior studies have investigated the relationship between emotion and reading, those studies have concentrated primarily on relatively static and distal measures of emotion. In this research, we measured…

English language learners (ELLs) and their teachers, schools, and communities face increasingly high-stakes consequences due to test score gaps between ELLs and non-ELLs. It is essential that the field of educational assessment continue to investigate the meaning of these test score gaps. This article discusses the findings of an exploratory study…

This quasi-experimental value-added study provided evidence for the predictive validity of the Massachusetts MTEL General Curriculum Mathematics Subtest by finding an association between the licensure test results of 130 teachers and the growth of their 2640 grade 4 and 5 students. The study took advantage of a natural experiment that arose due to…

We present work toward automatically assessing and estimating science inquiry skills as middle school students engage in inquiry within a physical science microworld. Towards accomplishing this goal, we generated machine-learned models that can detect when students test their articulated hypotheses, design controlled experiments, and engage in…

This study examined whether the spelling abilities of adults with low literacy skills could be predicted by their phonological, orthographic, and morphological awareness. Sixty Adult Basic Education (ABE) students completed several literacy tasks. It was predicted that scores on phonological and orthographic tasks would explain variance in…

Students conducted inquiry using simulations within a rich learning environment for 4 science topics. By applying educational data mining to students' log data, assessment metrics were generated for two key inquiry skills, testing stated hypotheses and designing controlled experiments. Three models were then developed to analyze the transfer of…

The Massachusetts Department of Elementary and Secondary Education (Department) created the grades 1-12 Early Warning Indicator System (EWIS) in response to district interest in the Early Warning Indicator Index (EWII) that the Department previously created for rising grade 9 students. Districts shared that the EWII data were helpful, but also…