This study is an evaluation of the psychometric issues associated with estimating objective level scores, often referred to as "subscores." The article begins by introducing the concepts of reliability and validity for subscores from statewide achievement tests. These issues are discussed with reference to popular scaling techniques, classical…

Two attempts to adjust state mean Scholastic Aptitude Test (SAT) scores for differential participation rates are examined. Both attempts are rejected, and five rules for performing adjustments are outlined to foster follow-up checks on untested assumptions. National Assessment of Educational Progress state data are determined to be more accurate.…

Portfolios are the centerpiece of Vermont's statewide assessment program in mathematics. Portfolio scores in the first two years were not reliable enough to permit the reporting of student-level results, but increasing the number of readers or the number of portfolio pieces is not operationally feasible. (SLD)

Key findings of a pilot study of the Alaska Instructional Diagnostic System (AIDS) are summarized. The AIDS pilot test served to verify the appropriateness of the skills survey as well as the validity and reliability of the items. The AIDS testing system includes three components: (1) upper level skills surveys (grades 3-8); (2) lower level skill…

The 1972-73 Michigan Educational Assessment Program (MEAP) provided information on 22 measures of students and schools. While some of the data were gathered in routine Michigan Department of Education reports, student performance data were gathered using the Michigan Assessment of Basic Skills battery, Form VMT during January 1973. The battery…

Performance based assessment refers to tasks that require students to construct responses or take actions to demonstrate specific knowledge or skills. Performance assessment tasks appear in a variety of formats, but they focus on higher order skills and are nonroutine, and sometimes loosely structured, in nature. A number of concerns have been…

This explanatory booklet and the materials that accompany it have two major purposes. The first purpose is to provide local school officials with information regaing the performance on basic skills achievement of each student who took the 1971-72 Michigan Educational Assessment Battery. The second purpose is to provide local officials with…

The 1992-93 school year saw the second statewide implementation of the Vermont portfolio-assessment program, and RAND continued its ongoing evaluation of the program's implementation, effects, and data quality. While the first year's study found evidence of the impact of the assessment program and low reliability of portfolio scoring, this year's…

This explanatory booklet and the materials that accompany it have two major purposes. The first purpose is to provide local school officials information regarding the performance on basic skills achievement of each student who took the 1972-73 Michigan Educational Assessment Battery. The second purpose is to provide local officials with…

The 1971-72 Michigan Educational Assessment Program (MEAP) provided information on 22 measures of students and schools. While some of the data were gathered in routine Michigan Department of Education reports, mean socioeconomic status (SES) for each school and student performance data were gathered in a special endeavor during January 1972. The…

The two major purposes of this study are: (1) To provide local school officials with information regarding the performance on basic skills achievement of each student who took the 1970-71 Michigan Educational Assessment Battery, and (2) To provide local officials with information that will assist them in understanding and interpreting their…

The 1992-93 school year was the second year of the implementation of the Vermont assessment program. Evaluation of the 1991-92 year yielded mixed results, with some evidence that the assessment program was having a strong impact on instruction, but other indications that the reliability of the portfolio scoring in both writing and mathematics was…

This technical report describes the procedures followed in developing the tests used in the California Assessment Program, the underlying principles of the program, the statistical characteristics of the tests, and the evidence that has been accumulated relating to the validity and reliability of the tests. The report also presents complete…

The North Carolina End-of-Course Testing Program is based on the assessment of higher level skills in the context of specific subject-area content. These tests inform students, parents, the community, and educators about the achievement of North Carolina students in given areas. This report describes the development and psychometric properties of…

School effectiveness indices (SEIs), based on regressing test performance onto earlier test performance and a socioeconomic status measure, were obtained for eight subject-grade combinations from 485 South Carolina elementary schools. The analysis involved school means based on longitudinally matched student data. Reading and mathematics…