This paper considers several philosophies as they relate to student assessment. Realists believe that one can know the real world as it truly is. As a philosophy of testing and measurement, realism is characterized by behaviorally stated objectives, measurement-driven instruction, and report cards, along with the use of programmed materials.…

The Microsoft Certification Program (MCP) includes many new computer-based item types, based on complex cases involving the Windows 2000 (registered) operating system. This Innovative Item Technology (IIT) has presented challenges beyond traditional psychometric considerations such as capturing and storing the relevant response data from…

Automated test assembly is a technology for producing multiple, equivalent test forms from an item pool. An important consideration for test security in automated test assembly is the inclusion of the same items on these multiple forms. Although it is possible to use item selection as a formal constraint in assembling forms, the number of…

This paper focuses on the use of accommodations by students with disabilities in large-scale assessment programs. The paper is divided into three sections. The first section summarizes the primary issues relevant to including students with disabilities in large-scale testing. The second sections summarizes the research on such participation in the…

This digest discusses the simulated oral proficiency interview (SOPI), a performance-based, tape-mediated speaking test. The SOPI follows the general structure of the oral proficiency interview (OPI) used by government agencies and the American Council on the Teaching of Foreign Languages (ACTFL) to measure speaking proficiency. Whereas the OPI is…

This guide explains the results and other information contained in the "Test Item Analysis Report," the "Test Item Report Summary," the "School Report," and the "District Report" for the Massachusetts Comprehensive Assessment System (MCAS) tests of spring 2002.The report contains these sections: (1)…

This report shares with educators and the public all of the test items on which spring 2002 student results from the Massachusetts Comprehensive Assessment System (MCAS) are based. The release of these items provides information on the kinds of knowledge and skills students are expected to demonstrate on the MCAS tests. Local educators are…

This paper reports on a study to see whether girls in middle school who took tests separately from boys did better than when they were tested together. A mathematics attitude and anxiety instrument was administered as part of the study to determine if either had any effect on test performance. Results indicate that boys were more anxious than…

The nature and extent of human error in educational testing over the past 25 years were studied. In contrast to the random measurement error expected in all tests, the presence of human error is unexpected and brings unknown, often harmful, consequences for students and their schools. Using data from a variety of sources, researchers found 103…

Tests and assessments are generally administered to gather data to aid in decision making, with at an individual student level or at an aggregated level. In order to incorporate assessment data in informed decision making, test users need to understand the test results. This chapter highlights the types of test scores and test score…

Using test results to improve instruction is vital to improving the education system, but equally important is to report results to other stakeholders. These stakeholders include the students who took the test, their parents or guardians, other parents in the school or district, the local school board, and the public at large. Effective reporting…

Item pools supporting computer-based tests are not always completely calibrated. Occasionally, only a small subset of the items in the pool may have actual calibrations, while the remainder of the items may only have classical item statistics, (e.g., "p"-values, point-biserial correlation coefficients, or biserial correlation…

The use of and emphasis on statistical significance testing has pervaded educational and behavioral research for many decades in spite of criticism by prominent researchers in this field. Much of the controversy is caused by lack of understanding or misinterpretations. This paper reviews criticisms of statistical significance testing and discusses…

The use of technology such as computers and programmable calculators enables students to find p-values and conduct tests of hypotheses in many different ways. Comprehension and interpretation of a research problem become the focus for statistical analysis. This paper describes how to calculate chisquare statistics and p-values for statistical…

There is variability in the estimation of an equating transformation because common-item parameters are obtained from responses of samples of examinees. The most commonly used standard error of equating quantifies this source of sampling error, which decreases as the sample size of examinees used to derive the transformation increases. In a…