The Cross-Classified Mixed Effects Model (CCMEM) has been demonstrated to be a flexible framework for evaluating reliability by measurement specialists. Reliability can be estimated based on the variance components of the test scores. Built upon their accomplishment, this study extends the CCMEM to be used for evaluating validity evidence.…

Reading motivation is an important contributor to reading achievement. Students with higher levels of motivation tend to outperform those with lower levels. Reading motivation is a dynamic, situational, context-dependent trait that can vary in children over time and across tasks. Teachers have a valuable opportunity to support students' reading…

Introduction: Reading comprehension is an important skill in the fast pace global society in which we now live. However, reading comprehension is a rather complex process that involves the dynamic interaction of cognitive and metacognitive skills. Method: In the present study, we investigated whether a newly-developed text inconsistency detection…

Computerized game-based assessment (GBA) system for screening reading difficulties may provide substantial time and cost benefits over traditional paper-and-pencil assessment while providing means also to individually adapt learning content in educational games. To study the reliability and validity of a GBA system to identify struggling readers…

Although several measures exist for frequently monitoring early reading progress, little research has specifically investigated their technical properties when administered on a frequent basis with kindergarten students. In this study, kindergarten students (N = 137) of whom the majority was receiving supplemental intervention for reading skills…

Curriculum-Based Measurement of Oral Reading (CBM-R) is often used to monitor student progress and guide educational decisions. Ordinary least squares regression (OLSR) is the most widely used method to estimate the slope, or rate of improvement (ROI), even though published research demonstrates OLSR's lack of validity and reliability, and…

This study aimed at investigating the effect of two strategies of teaching reading: 'semantic mapping' and 'question generation' on the reading achievement of a sample of 40 female students enrolling in two classes in Level 2 English as a Second Language Foundation Program at the Community College of Qatar. The researcher of the current study…

Northwest Evaluation Association™ (NWEA™) is committed to providing partners with useful tools to help make inferences from Measures of Academic Progress® (MAP®) interim assessment scores. One important tool is the concordance table between MAP and state summative assessments. Concordance tables have been used for decades to relate scores on…

The present study examined the technical adequacy of maze-selection tasks constructed in 2 different ways: typical versus novel. We selected distractors for each measure systematically based on rules related to the content of the passage and the part of speech of the correct choice. Participants included 262 middle school students who were…

Almost half of American adults struggle with reading but there is a dearth of reading-related assessments for these adults. In turn, researchers and practitioners use assessments designed for children with these adults. This study examined the psychometric and descriptive attributes of the Comprehensive Test of Phonological Processing (CTOPP)…

The role of classroom teachers in the early detection of learning difficulty/disability in school children cannot be ignored. When it comes to young children's literacy learning, there is substantial consensus that the teacher is the primary assessment agent (Johnston & Rogers, 2002). But classroom teachers also have a lot of responsibilities…

We evaluated the technical adequacy of oral reading fluency (ORF) probes in which 1,472 middle school students with and without reading difficulties read fluency probes for 60 s versus reading the full passage. Results suggested that the reliability of 60-s probes (rs = 0.75) was not substantively different than full passage probes (rs = 0.77)…

Standard setting methods, like the Bookmark procedure, are used to assist education experts in formulating performance standards. Small group discussion is meant to help these experts in setting more reliable and valid cutoff scores. This study is an analysis of 15 small group discussions during two standards setting trajectories and their effect…

Two studies explored the technical adequacy of various measures of advanced phonics skills. In Study 1, the advanced phonics measures consisted of pseudowords, real words, or a combination of both. Participants included 39 students in the third grade. Test-retest correlations for all measures were above 0.8 and interrater reliability was high.…

The ability to recognize sight words, phonological awareness, syntax, semantics, and pragmatic skills begins to develop during the preschool period, and is important for formal reading education. The purpose of this study was to define individualized studies that support the development of literacy skills among hearing-impaired preschool children.…