Substantial research effort has recently focused on the potential protective effect of cognitively demanding activities on cognitive decline in late life. A significant methodological issue in this effort has been the lack of consistency in approaches to the operational measurement of cognitive activity. In this study, data in support of the…

The purpose of this study was to compare the effects of two peer assessment methods on university students' academic writing performance and their satisfaction with peer assessment. This study also examined the validity and reliability of student generated assessment scores. Two hundred and thirty-two predominantly undergraduate students were…

Contemporary testing standards place test purpose as the central focus during test development and subsequent use. This study describes the development of a measure for children designed explicitly to measure change resulting from psychosocial interventions. Parents completed the outcome measure for 896 elementary school-age children receiving…

Schools are increasingly using curriculum-based measurement reading procedures to conduct universal screenings as a means of identifying students whose level and rate of growth are discrepant from peers. Despite abundant evidence supporting the reliability and validity of curriculum-based measurement-reading procedures, researchers have not fully…

This study describes the initial validation of an innovative social-behavioral observational assessment tool that is designed to be used on a repeated basis to assess growth and development of social competence over time to: (a) identify the social functioning of all students, (b) assist in planning support for students at risk, and (c) evaluate…

In tests with time limits, items at the end are often not reached. Usually, the pattern of missing responses depends on the ability level of the respondents; therefore, missing data are not ignorable in statistical inference. This study models data using a combination of two item response theory (IRT) models: one for the observed response data and…

The purposes of this study were to examine the reliability and validity of a 4-factor model of the Drinking Motives Measure and to assess year in school and ethnic differences on different types of motives. Data were collected on 441 volunteer college students. Results indicated that fit indices for the 4-factor model were acceptable; fit indices…

In writing assessment, there are quite a number of factors influencing the marking stability and the reliability of the assessment such as the attitude towards marking and consistency of markers, the physical environment, the design of the items, and marking rubrics. Even the methods to train markers have effects on the reliability of the…

The CATO Institute's Policy Analysis "They Spend WHAT? The Real Cost of Public Schools" contends that the figures most commonly associated with spending on K-12 public education do not include all relevant expenditures. It also cites survey evidence suggesting that voters underestimate the cost of education and, when presented with a higher…

The Education Trust research report "Stuck Schools" suggests a framework for identifying chronically low-performing schools in need of turnaround. The study uses Maryland and Indiana to show that some low-performing schools make progress while others remain stagnant. The report has four serious problems of reliability and validity,…

In this technical report, we provide reliability and validity evidence for the easyCBM[R] Reading measures for grade 2 (word and passage reading fluency and multiple choice reading comprehension). Evidence for reliability includes internal consistency and item invariance. Evidence for validity includes concurrent, predictive, and construct…

The purposes of this study were to investigate the reliability and construct validity of measures of reading component skills with a sample of adult basic education (ABE) learners, including both native and nonnative English speakers, and to describe the performance of those learners on the measures. Investigation of measures of reading components…

A protocol for analyzing the activity structure of a classroom lesson was developed and field tested. The protocol can be completed on site by a person serving as both observer and analyst. Validity of the protocol was established by reference to the large body of qualitative research on activity structure and the analysis of teaching. The…

This report gives some simple examples of stability for one factor and 2 x 2 factorial analysis of variance, reliability and correlations. The findings are very different: from superstability (no transformation whatsoever can change the result) to almost total instability. This is followed by a discussion of applications to multivariate analysis,…

Today's psychological measurement depends almost exclusively on the "standardized test." A certain amount of non-standardization, however, exists in the administration of any standardized test, with the amount unknown for any given test score. Time limits on tests pose a bigger problem since another variable is introduced, pressure. Test taking…