Measuring the implementation fidelity (IF) or integrity of interventions is crucial, otherwise a positive or negative outcome cannot be interpreted. Direct and indirect methods of IF measurement tend to over-emphasize teacher behaviour. This paper focuses on IF measured by student behaviour collected through computers. Attainment was measured by…

Over the past decade, large-scale testing programs have employed technology-enhanced items (TEI) to improve the fidelity with which an item measures a targeted construct. This paper presents findings from a review of released TEIs employed by large-scale testing programs worldwide. Analyses examine the prevalence with which different types of TEIs…

Background/Context: Funders, researchers and developers share an interest in applying rapid cycle evaluation techniques in education (McNall & Foster-Fishman, 2007; Resch, 2016). Both rapid-cycle and other evaluation processes require monitoring the quality of implementation (Moir, 2018). By quickly monitoring and adjusting implementation,…

The purpose of this evaluation was to examine the impact of i-Ready Personalized Instruction that met Curriculum Associates' recommended usage levels on mathematics achievement, as measured by the Massachusetts Comprehensive Assessment System (MCAS) mathematics assessment. This study compared mathematics achievement growth of students who used…

Interest in and use of technology-enhanced items has increased over the past decade. Given the additional time required to administer many technology-enhanced items and the increased expense required to develop them, it is important for testing programs to consider the utility of technology-enhanced items. The Technology-Enhanced Item Utility…

The purpose of this evaluation was to examine the impact of i-Ready Personalized Instruction that met Curriculum Associates' recommended usage levels on ELA achievement, as measured by the Massachusetts Comprehensive Assessment System (MCAS) ELA assessment. This study compared the ELA achievement growth in the 2020-21 school year of students who…

Curriculum Associates' "i-Ready® Personalized Instruction" ("i-Ready") is a supplemental, online personalized instruction program available for reading and mathematics. Prior research has indicated "i-Ready" has a positive impact on K-8 student achievement for students overall (e.g., Swain, Randel, & Norman…

Curriculum Associates' "i-Ready® Personalized Instruction" ("i-Ready") is a supplemental, online personalized instruction program available for mathematics and reading. Prior research has indicated "i-Ready" has a positive impact on student achievement for students overall (e.g., Swain, Randel, & Norman Dvorak,…

Most computerized adaptive tests (CATs) have been studied using the framework of unidimensional item response theory. However, many psychological variables are multidimensional and might benefit from using a multidimensional approach to CATs. This study investigated the accuracy, fidelity, and efficiency of a fully multidimensional CAT algorithm…

In 2014, a new General Education Development (GED) assessment will be implemented. The new, more rigorous test will be aligned with the Common Core State Standards (CCSS) and will use a new test delivery model-computer-based testing (CBT) to replace the paper-and-pencil examination. These two changes have important implications for correctional…

The aim of the International Society for Technology, Education, and Science (iHSES) conference is to offer opportunities to share ideas, discuss theoretical and practical issues, and connect with the leaders in the fields of "humanities," "education" and "social sciences." It is organized for: (1) faculty members in…

One of the most widely used commercially available systems incorporating benchmark assessment and training in differentiated instruction is the Northwest Evaluation Association's (NWEA) Measures of Academic Progress (MAP) program. The MAP program involves two components: (1) computer-adaptive assessments administered to students three to four…

In 2010-11, Wake County Public School System (WCPSS), North Carolina Department of Public Instruction (NCDPI), and SMART Technologies began a two-year collaboration to promote the use of formative assessment in mathematics classrooms at three Wake County public schools: Millbrook Elementary, East Millbrook Middle, and Millbrook High school. The…

In the context of practicing intercultural communication skills, we investigated the role of fidelity in a game-based, virtual learning environment as well as the role of feedback delivered by an intelligent tutoring system. In 2 experiments, we compared variations on the game interface, use of the tutoring system, and the form of the feedback.…