This document is one of eight reports prepared to support the development of a new learning system, an effort that is the first step in a major initiative undertaken by the Stupski Foundation. The report was created collaboratively by researchers from McRel with guidance from officers of the Stupski Foundation. Its purpose is to provide members of…

With the increase of Latino preschoolers, it is pressing that early childhood teachers are prepared to create a high quality environment in which all children can succeed. Using the frameworks of cultural responsiveness and classroom management, we developed the Early Childhood Ecology Scale (ECES) as an observational and reflective tool to…

Background: Validity is a central concern in any assessment, though this has often not been made explicit in the UK assessment context. This article applies current validity theorising, largely derived from American formulations, to national curriculum assessments in England. Purpose: The aim is to consider validity arguments in relation to the…

Background: National curriculum tests have been administered in England for well over a decade. Although reliability evidence has been published, critics have argued that there is not enough evidence (of the right kind) and that test results may be insufficiently reliable. Purpose: This article collates and discusses evidence on the reliability of…

The purpose of this research is to develop a performance evaluation instrument for green schools in Taiwan. The instrument is designed according to three sets of criteria: participation and partnership, reflection and learning, and ecological consideration. It also covers three operational dimensions: learning context, administration, and…

The aim of this study is to explore the possible relationships between the readiness and reading and writing performances of a group of children who are first graders in an elementary school in Turkey. The states of children in terms of school readiness, sound-letter relationships, and phonemic awareness were determined individually during the…

The Woodcock Johnson III Brief Assessment is a "maximum performance test" (Reynolds, Livingston, Willson, 2006) that is designed to assess the upper levels of knowledge and skills of the test taker using both power and speed to obtain a large amount of information in a short period of time. The Brief Assessment also provides an adequate…

The present study examines the validity of the Dutch Children's Communication Checklist (CCC) for children in kindergarten in a community sample, in order to assess the feasibility of using it as a screening instrument in the general population. Teachers completed the CCC for a representative sample of 1396 children at kindergarten level, taken…

This study presents psychometric characteristics of the mathematics problem solving performance assessment used in the Minneapolis Public Schools, focusing on the interrater reliability, scoring reliability, and validity of the assessment. The Minneapolis Math Problem Solving Assessment (MPSA) was established in 1991. Students are asked to solve…

To determine trends in reporting test reliability, 88 articles addressing 188 instruments in 1980, 81 articles covering 205 instruments in 1985, and 67 articles assessing 195 instruments in 1990 in the "Journal of Counseling Psychology" were reviewed. Articles were examined for the way in which reliability was discussed and reported, and…

A preliminary study is reported of the use of new multifaceted Rasch measurement mechanisms for investigating rater characteristics in language testing. Ratings from four judges of scripts from 50 candidates taking the International English Language Testing System test, a test of English for Academic Purposes, are analyzed. The analysis…

Cason and Cason's model of performance rating was used to determine the extent to which variation in reviewer standards affected the reliability and validity of the program review process used to select papers for inclusion in the annual program. Data analyzed were the overall recommendation for acceptance and ratings on seven quality criteria…

Generalizability theory, which subsumes classical measurement theory as a special case, provides a general model for estimating the reliability of observational rating data by estimating the variance components of the measurement design. Research data from the "Heart Smart" health intervention program were analyzed as a heuristic tool.…

A large number of seemingly diverse coefficients have been proposed as indices of dependability, or reliability, for domain-referenced and/or mastery tests. In this paper, it is shown that most of these indices are special cases of two generalized indices of agreement: one that is corrected for chance, and one that is not. The special cases of…

Teachers and classroom aides of learning disabled students completed the Conners Abbreviated Teacher Rating Scale (CATRS) on two separate occasions. The study investigated the inter-rater and intra-rater reliability of this instrument. CATRS appeared to have sufficient reliability to recommend its continued frequent use. (Author/DWH)