This document describes the breadth of the research that the ETS (Educational Testing Service) Research & Development division is conducting in 2010. This portfolio will be updated in early 2011 to reflect changes to existing projects and new projects that were added after this document was completed. The research described in this portfolio falls…

A statistical model is proposed that describes the determination of an educational outcome variable as a nonlinear function of explanatory variables defined at different levels of a survey data hierarchy, such as students and classes. The theoretical and practical derivation of the model is discussed, and an example is given. (Author/BW)

This study addressed statistical techniques that might ameliorate some of the sampling problems currently facing states with small populations participating in State National Assessment of Educational Progress (NAEP) assessments. The study explored how the application of finite population correction factors to the between-school component of…

Two approaches, the minimax approach and the Rasch procedure, are described for the simultaneous determination of passing scores for subtests when the passing score for the total test is known. (Author/LMO)

This study was designed to illustrate the use of the Rasch model procedure to equate the Dade County Compensatory Education Skills Test (DCCEST) to the State Student Assessment Test (SSAT) for both mathematics skills and communications skills. The SSAT was a test developed by the Florida State Department of Education to measure students' level of…

The assertion that Model C is feasible for Elementary Secondary Education Act Title I evaluation, why it is feasible, and reasons why it is so seldom used are explained. Two assumptions must be made to use the special regression model. First, a strict cut-off must be used on the pretest to assign students to Title I and comparison groups. Second,…

A statistical analysis was conducted to examine changes across time in some school districts of Pennsylvania. Comparisons were made for grades 5, 8, and 11 during two assessment periods. The Educational Quality Assessment data provided the basis for analysis. Correlation coefficients for school mean goal scores are displayed. Changes at the three…

A standard-setting procedure was developed for the Georgia Teacher Certification Testing Program as tests in 30 teaching fields were revised. A list of important characteristics of a standard-setting procedure was derived, drawing on the work of R. A. Berk (1986). The best method was found to be a highly formalized judgmental, empirical Angoff…

Efficient methods of using the Statistical Package for the Social Sciences (SPSS) to analyze National Assessment of Educational Progress (NAEP) data files are discussed. One error in the NAEP SPSS file is discussed, and another error (which may be system-dependent) is mentioned. In addition, purely mathematical methods are used to address the…

In 1971, a comprehensive study was made of mathematics and reading achievement in the Borough of North York, Ontario. In 1974, a replication and followup study was carried out. The purposes of the study were to replicate the 1972 study, and to obtain a measure of growth in reading and mathematics achievement between grade 3 and grade 5, over the…

In this replication of the 1972 and 1974 studies of reading and mathematics achievement in North York, Ontario, approximately 20 percent of the students at each of the proposed grade levels were included in the sampling. Again, the Metropolitan Achievement Test, the Sequential Tests of Educational Progress, and the School and College Ability Test…

Results of new research into the anomalous results of the 1986 reading portion of the National Assessment of Educational Progress (NAEP) are reported. The original analysis of the 1986 data indicated that the estimated performance level of 9- and 17-year-old students had dropped dramatically since 1984, whereas the performance of 13-year-olds had…

The Pennsylvania Educational Quality Assessment data have consistently shown differences between rural, suburban, and urban schools in terms of performance on goal areas and on important background variables. The most consistent pattern has been demonstrated by achievement on cognitive measures. The analyses reported upon were conducted on the…

This research compared the cut-off scores estimated from an empirical procedure (Contrasting group method) to those determined from a more theoretical process (Nedelsky method). A methodological and statistical framework was also provided for analysis of the data to obtain the most appropriate standard using the empirical procedure. Data were…

This pamphlet explains a child's Massachusetts Comprehensive Assessment System (MCAS) "Student Report for Parents/Guardians." In spring 1999, more than 210,000 students from grades 4, 8, and 10 in Massachusetts took the state's MCAS tests. All public students in grades 4, 8, and 10 are required to participate, and the Education Reform…