Monitoring applications (MAs) use digital and online tools to collect and track data on student behavior, and they have become increasingly popular among schools. Empirical research on these complex surveillance platforms is scant, and little is known about the efficacy or impact that they have on students. This study used a multi-method…

This study examined reading tutors' interpretation of reading progress-monitoring graphs. A think-aloud procedure was used to evaluate tutors at two points in time, before and after a year of service as an AmeriCorps reading tutor. During their service, the reading tutors received extensive training and ongoing coaching. Descriptive results showed…

Although many schools in the Netherlands have purchased adaptive learning systems (ALSs) to reduce workload and improve differentiated instruction, the use of ALSs with teacher dashboards in the classroom does not in itself necessarily improve differentiated instruction. The question is, what skills and knowledge do teachers need to provide…

Curriculum-Based Measurement of Reading (CBM-R) is frequently used to monitor instructional effects and evaluate response to instruction. Educators often view the data graphically on a time-series graph that might include a variety of statistical and visual aids, which are intended to facilitate the interpretation. This study evaluated the effects…

In tiered instructional systems (Response to Intervention [RTI]/Multitier System of Supports [MTSS]) that rely on ongoing assessment of students at risk of experiencing academic difficulties, the ability to make informed decisions using student data is critical for student learning. Prior research has demonstrated that, on average, teachers have…

Research has shown that: (1) Curriculum-based monitoring (CBM) can be easily implemented and interpreted by teachers (e.g., Fuchs, Deno, & Mirkin, 1984); (2) student outcomes have improved when teachers use CBM to inform instructional decision making (e.g., Fuchs, Fuchs, Hamlett, & Stecker, 1991); (3) reliable and valid measures have been…

The Education Council of the Council of Australian Governments (COAG) commissioned a review of the current approach to the presentation of the National Assessment Program -- Literacy and Numeracy (NAPLAN) data including information published on the "My School" website. The review was framed by four Terms of Reference, namely: (1)…

Curriculum based measurement of reading (CBM-R) is used to monitor the effects of academic interventions for individual students. Decisions to continue, modify, or terminate instructional programs are made by interpreting patterns of observations collected across time. Educators visually analyze or apply decision rules to evaluate student…

In critiquing our paper on "The literacy performance of ex-Reading Recovery students between two and four years following participation in the program: Is this intervention effective for students with early reading difficulties?", Schwartz argues that we have engaged in pursuing political and ideological agendas as part of our ongoing…

In this paper, I describe preliminary work on a new research project in learning analytics at Arizona State University. In conjunction with an innovative remedial mathematics course using Khan Academy and student coaches, this study seeks to measure the effectiveness of visualized data in assisting student coaches as they help remedial math…

Evaluators report effects of education initiatives as standardized effect sizes, a scale that has merits but obscures interpretation of the effects' practical importance. Consequently, educators and policymakers seek more readily interpretable translations of evaluation results. One popular metric is the number of years of learning necessary to…

This article is a commentary of a paper by Derek C. Briggs and Frederick A. Peck, "Using Learning Progressions to Design Vertical Scales That Support Coherent Inferences about Student Growth," which describes an elegant potential framework for at least beginning to address three priorities in large-scale assessment that have not been…

The growth in the availability of longitudinal data--data collected over time on the same individuals--as part of program evaluations has opened up exciting possibilities for evaluators to ask more nuanced questions about how individuals' outcomes change over time. However, in order to leverage longitudinal data to glean these important insights,…

A Response-to-Intervention (RTI) model of educational service delivery is a multi-tiered, preventative approach designed to meet the educational and behavioral needs of all learners. While the New York State (NYS) Department of Education has mandated the use of this model in grades K-4, the extent to which RTI competencies are taught within…

The "Washington English Language Proficiency Assessment" (WELPA) is a No Child Left Behind (NCLB)-compliant instrument that is used in Grades K-12 as a formal and standardized method of measuring language proficiency. The test results provide important information for classifying English Language Learners (ELLs) and subsequently for…