The current study examines the technical adequacy of four Early Numeracy Curriculum-Based Measurement (EN-CBM) screening tasks: "Oral Counting" (OC), "Number Identification" (NI), "Quantity Discrimination" (QD), and "Missing Number" (MN). Results from 59 kindergarten students assessed in the fall and spring reveal moderate to high test-retest and…

Despite their increasing use, composite indicators remain controversial. The undesirable dependence of countries' rankings on the preliminary normalization stage, and the disagreement among experts/stakeholders on the specific weighting scheme used to aggregate sub-indicators, are often invoked to undermine the credibility of composite indicators.…

The "PISA 2009 Technical Report" describes the methodology underlying the PISA 2009 survey. It examines additional features related to the implementation of the project at a level of detail that allows researchers to understand and replicate its analyses. The reader will find a wealth of information on the test and sample design,…

The results of a two-year study indicate that collaborative testing is a valuable pedagogical strategy that can both assess and enhance student learning. After finishing their first attempt at each exam, students were given a second attempt either working collaboratively in small groups or individually with open books and notes. Collaborative…

In survey research, sometimes the formation of groupings, or aggregations of cases on which to make an inference, are of importance. Of particular interest are the situations where the cases aggregated carry useful information that has been transferred from a sample employed in a previous study. For example, a school to be included in the sample…

In January 2009, in the last week of the Bush Administration, the U.S. Department of Education (ED), upon orders from the departing political appointee staff, published the final report in a long running National Evaluation of Upward Bound (UB). The study was conducted by the contractor, Mathematica Policy Research. After more than a year in…

The kappa coefficient and the chi square statistic are used as indices of agreement between two judges' ratings of a set of stimuli on a nominal scale. In this article, the logic of these indices is extended to weighted multi-way cases. (Author/JKS)

The scores on two distinct tests (e.g., essay and objective) are often combined into a composite score, which is used to make decisions. The validity of the observed composite can sometimes be evaluated relative to a separate criterion. In cases where no criterion is available, the observed composite has generally been evaluated in terms of its…

The Schools and Staffing Survey (SASS) is conducted by the National Center for Education Statistics (NCES) on behalf of the United States Department of Education in order to collect extensive data on American public and private elementary and secondary schools. SASS provides data on the characteristics and qualifications of teachers and…

The debate around which factors drive medical students' learning is ongoing and controversial. What is the influence of an assessment's weighting on the motivation of students to study the particular subject? One medical school in London is in a unique position to investigate this question. At our institution, the weighting of Anatomy within the…

Adding to the growing debate and evidence base on the effects of charter schools, this evaluation was conducted in 36 charter middle schools in 15 states. It compares the outcomes of 2,330 students who applied to these schools and were randomly assigned by lotteries to be admitted (lottery winners) or not admitted (lottery losers) to the schools.…

In writing assessment, there are quite a number of factors influencing the marking stability and the reliability of the assessment such as the attitude towards marking and consistency of markers, the physical environment, the design of the items, and marking rubrics. Even the methods to train markers have effects on the reliability of the…

In practice, teacher induction is common, but induction that is intensive, comprehensive, structured, and sequentially delivered in response to teachers' emerging pedagogical needs is less so. Congressional interest in formal, comprehensive teacher induction has grown in recent years. The National Center for Education Evaluation and Regional…

Four methods for combining several scores of tests given the same individual are discussed: (1) weighted standardized scores; (2) percentile rank methods; (3) the principal components approach; and (4) the optimal weights method. The optimal weights method is recommended because of its simplicity. (SLD)

A method is presented for investigating two aspects of the sensitivity of a linear composite to the values of its weights. A composite very similar to the original can be produced by weights very different from the original weights. (SLD)