We investigate two research questions using a recent statewide transition from paper to computer-based testing: first, the extent to which test mode effects found in prior studies can be eliminated in large-scale administration; and second, the degree to which online and paper assessments offer different information about underlying student…

We investigate two research questions using a recent statewide transition from paper to computer-based testing: first, the extent to which test mode effects found in prior studies can be eliminated; and second, the degree to which online and paper assessments offer different information about underlying student ability. We first find very small…

Chronic absenteeism is a critical issue that has been linked to many adverse student outcomes. The current study focuses on improving a key system already in place in many school districts--early warning systems (EWSs)--in order to decrease chronic absenteeism in students' earliest schooling years. Using a demographically diverse population of…

Prior work has documented a substantial penalty associated with taking the Partnership for Assessment of Readiness for College and Careers (PARCC) online relative to on paper (Backes & Cowan, 2019). However, this penalty does not necessarily make online tests less useful. For example, it could be the case that computer literacy skills are…

Summative assessments measure students' mastery of grade-level academic standards and skills in specific content areas after learning. State summative assessment systems provide students and families, school and district leaders, and state policymakers with valuable data to help understand student progress and school quality. This Policy Guide…

One of the reported methods of cheating in online environments in the literature is CAMEO (Copying Answers using Multiple Existences Online), where harvesting accounts are used to obtain correct answers that are later submitted in the master account which gives the student credit to obtain a certificate. In previous research, we developed an…

Along with many other institutions of higher education, the COVID-19 pandemic prompted Northeastern University to move courses online for the second half of the spring semester and beyond. As this crisis unfolded, faculty turned to the Center for Advancing Teaching and Learning Through Research (CATLR) for support on how to conduct their courses…

Nearly two dozen states now administer online exams to deliver testing to K-12 students. These tests have real consequences: their results feed into accountability systems, which have been used for more than a decade to hold schools and districts accountable for their students' learning. We examine the rollout of computer-based testing in…

The purpose of this evaluation was to examine the impact of i-Ready Personalized Instruction that met Curriculum Associates' recommended usage levels on mathematics achievement, as measured by the Massachusetts Comprehensive Assessment System (MCAS) mathematics assessment. This study compared mathematics achievement growth of students who used…

The purpose of this evaluation was to examine the impact of i-Ready Personalized Instruction that met Curriculum Associates' recommended usage levels on ELA achievement, as measured by the Massachusetts Comprehensive Assessment System (MCAS) ELA assessment. This study compared the ELA achievement growth in the 2020-21 school year of students who…

Nearly two dozen states now administer online exams. These tests have real consequences: their results feed into accountability systems, which have been used for more than a decade to hold schools and districts accountable for their students' learning. We examine the rollout of computer-based testing in Massachusetts over 2 years to investigate…

The Mobile Autism Risk Assessment (MARA) is a new, electronically administered, 7-question autism spectrum disorder (ASD) screen to triage those at highest risk for ASD. Children 16 months-17 years (N = 222) were screened during their first visit in a developmental-behavioral pediatric clinic. MARA scores were compared to diagnosis from the…

The Common Core State Standards (CCSS) for K-12 English language arts/literacy and mathematics, released in 2010, have been adopted by 49 states and territories; the District of Columbia; and the U.S. Department of Defense schools, which serve the children of U.S. service members around the world. The widespread adoption of the CCSS is a major…

There are well-acknowledged challenges to scaling computerized performance-based assessments. One such challenge is reliably and validly identifying ill-defined skills. We describe an approach that leverages a data mining framework to build and validate a detector that evaluates an ill-defined inquiry process skill, designing controlled…

The first operational administration of the Partnership for Assessment of Readiness for College and Careers (PARCC) took place during the 2014-2015 school year. In addition to the traditional paper-and-pencil format, the assessments were available for administration on a variety of electronic devices, including desktop computers, laptop computers,…