Measuring the implementation fidelity (IF) or integrity of interventions is crucial, otherwise a positive or negative outcome cannot be interpreted. Direct and indirect methods of IF measurement tend to over-emphasize teacher behaviour. This paper focuses on IF measured by student behaviour collected through computers. Attainment was measured by…

Over the past decade, large-scale testing programs have employed technology-enhanced items (TEI) to improve the fidelity with which an item measures a targeted construct. This paper presents findings from a review of released TEIs employed by large-scale testing programs worldwide. Analyses examine the prevalence with which different types of TEIs…

Background/Context: Funders, researchers and developers share an interest in applying rapid cycle evaluation techniques in education (McNall & Foster-Fishman, 2007; Resch, 2016). Both rapid-cycle and other evaluation processes require monitoring the quality of implementation (Moir, 2018). By quickly monitoring and adjusting implementation,…

The purpose of this evaluation was to examine the impact of i-Ready Personalized Instruction that met Curriculum Associates' recommended usage levels on mathematics achievement, as measured by the Massachusetts Comprehensive Assessment System (MCAS) mathematics assessment. This study compared mathematics achievement growth of students who used…

The purpose of this evaluation was to examine the impact of i-Ready Personalized Instruction that met Curriculum Associates' recommended usage levels on ELA achievement, as measured by the Massachusetts Comprehensive Assessment System (MCAS) ELA assessment. This study compared the ELA achievement growth in the 2020-21 school year of students who…

Curriculum Associates' "i-Ready® Personalized Instruction" ("i-Ready") is a supplemental, online personalized instruction program available for reading and mathematics. Prior research has indicated "i-Ready" has a positive impact on K-8 student achievement for students overall (e.g., Swain, Randel, & Norman…

Curriculum Associates' "i-Ready® Personalized Instruction" ("i-Ready") is a supplemental, online personalized instruction program available for mathematics and reading. Prior research has indicated "i-Ready" has a positive impact on student achievement for students overall (e.g., Swain, Randel, & Norman Dvorak,…

Most computerized adaptive tests (CATs) have been studied using the framework of unidimensional item response theory. However, many psychological variables are multidimensional and might benefit from using a multidimensional approach to CATs. This study investigated the accuracy, fidelity, and efficiency of a fully multidimensional CAT algorithm…

In the context of practicing intercultural communication skills, we investigated the role of fidelity in a game-based, virtual learning environment as well as the role of feedback delivered by an intelligent tutoring system. In 2 experiments, we compared variations on the game interface, use of the tutoring system, and the form of the feedback.…