This study evaluated the construct validity of six scoring traits of an automated writing evaluation (AWE) system called "MI Write." Persuasive essays (N = 100) written by students in grades 7 and 8 were randomized at the sentence-level using a script written with Python's NLTK module. Each persuasive essay was randomized 30 times (n =…

This paper presents results of a score interpretation study for a computer adaptive mathematics assessment. The study purpose was to test the efficacy of item developers' alignment of items to Range Achievement-Level Descriptors (RALDs; Egan et al.) against the empirical achievement-level alignment of items to investigate the use of RALDs as the…

The purpose of this study was to analyze the relationship between the level of physical activity, social physique anxiety, and academic achievement. This study evaluated 524 students in total from four schools in Istanbul province, 272 of whom were female and 252 were male students. In order to determine the level of physical activity of students,…

Background: Several different measures have been proposed to solve persistent validity problems, such as high task-sampling variability, in the assessment of students' expertise in 'doing science'. Such measures include working with a-priori progression models, using standardised item shells and rating manuals, augmenting the number of tasks per…

International large-scale assessments (ILSAs) have become an important part of the Swedish evaluation system. It is therefore of crucial importance to validate national measures of Swedish students' achievement with their ILSA test scores. Here, we offer results from such a validation study based on Swedish students' test scores in IEA's Trends in…

The purpose of this study was to investigate exam scores' predicting Transition from Primary to Secondary Education (TEOG) exam scores. The research data were obtained from the records of 1035 students studying at the first term of eighth grade in 2015-2016 academic year in e-school system. The research was on relational screening model. Linear…

This study examines the power of cognitive and noncognitive variables to predict students' performance in algebra. We investigated students' prior year's assessment scores and demographic characteristics to predict eighth-grade algebra scores. Using California statewide assessment data, we explored predictive factors in three regression models.…

During the past decade, the NAEP Validity Studies (NVS) Panel has been monitoring, studying, and commenting on potential issues with the validity of the National Assessment of Educational Progress (NAEP) arising from changes that have been brought about by the adoption of rigorous state college and career readiness standards, such as the Common…

Students with and without learning disabilities often struggle to learn a foreign language (FL). Teachers could benefit from a measure designed to screen and identify students at risk for FL learning difficulties. In this study, we examined the reliability and validity of scores from four curriculum-based measures (CBM) as potential indicators of…

The current dissertation gathered empirical evidence of convergent and predictive validity for the Self-Regulation Strategies Inventory-Parent Rating Scale (SRSI-PRS), which measures parents' perception of their child's use of self-regulated learning (SRL) strategies during mathematics activities. The SRSI-PRS, which is part of the larger SRSI…

The present study examined the technical adequacy of maze-selection tasks constructed in 2 different ways: typical versus novel. We selected distractors for each measure systematically based on rules related to the content of the passage and the part of speech of the correct choice. Participants included 262 middle school students who were…

Though measures of long-term academic performance trends are valuable to education policy analysts and policymakers, they have been hard to come by at the state level, where most education policy is made. Such data are either nonexistent prior to 1990 or are unrepresentative of statewide student populations. A continuous series of state mean SAT…

Observational methods are increasingly being used in classrooms to evaluate the quality of teaching. Operational procedures for observing teachers are somewhat arbitrary in existing measures and vary across different instruments. To study the effect of different observation procedures on score reliability and validity, we conducted an experimental…

Florida requires that students who do not meet grade-level reading proficiency standards on the end-of-year state assessment (Florida Comprehensive Assessment Test, FCAT) receive intensive reading intervention. With the stakes so high, teachers and principals are interested in using screening or diagnostic assessments to identify students with a…

To provide timely and effective supports for students reading below grade level, schools require methods for quickly and accurately identifying those students in need. One method for identifying those students is through universal screening. Assessments such as oral reading fluency (ORF) and Maze reading comprehension are commonly used as…