When student affairs professionals assess their work, they often employ some type of survey. The use of surveys stems from a desire to objectively measure outcomes, a demand from someone else (e.g., supervisor, accreditation committee) for data, or the feeling that numbers can provide an aura of competence. Although surveys are effective tools for…

In the United States, when English language learners (ELLs) are tested, they are usually tested in English and their limited English proficiency is a potential cause of construct-irrelevant variance. When such irrelevancies affect test scores, inaccurate interpretations of ELLs' knowledge, skills, and abilities may occur. In this article, we…

Describes two new measures of consistency which refer to the extent to which more closely related scale types are found together in Holland's Self-Directed Search sort. One measure is based on the hexagonal model for use with three-point codes. The other is based on conditional probabilities for use with two-point codes. (Author/ABL)

The ultimate goal of the institutional researcher is not always to test a research hypothesis, but more often simply to find an appropriate model to gain an understanding of the underlying characteristics and interrelationships of the data. Exploratory data analysis provides a means of accomplishing this. (Author)

Claims the data from the Ohio Proficiency Test is rich but hard to use. Describes a process for analyzing the data to make it more manageable. Provides suggestions for using the results to make data-driven decisions. (NH)

The question of validity, or how high-stakes tests are being used and interpreted, threatens to undermine the entire standards movement. Joint standards developed by three professional associations say decisions affecting students' life chances should not be based on test scores alone. Objectivity and teaching to tests are real concerns. (MLH)

Fournier, coordinator of the School Achievement Indicators Program (SAIP), claims that score differences are associated with linguistic and gender differences. These results have long been substantiated. The expectation-setting process has little reliability or validity. SAIP does not help teachers, and should not determine what students learn.…

Too few researchers understand what statistical significance testing does and does not do, and consequently their results are misinterpreted. This Digest explains the concept of statistical significance testing and discusses the meaning of probabilities, the concept of statistical significance, arguments against significance testing,…

This guide presents ways for practitioners to use Chapter 1 achievement data to better understand and evaluate elements of a Chapter 1 program. A variety of types and levels of questions can be addressed with achievement data. Combining standardized achievement test scores with data from the program and from the regular classroom greatly increases…

Student achievement test results are the coin of the realm in educational accountability systems in the United States. For a number of years, both states and the federal government have relied heavily on tests to judge the quality of schools. The exact characteristics of the accountability systems have evolved over the years and vary a good deal…

Identifies situations in which there is disparity between coefficients calculated from aggregate versus individual level data. Determines the magnitudes of these discrepancies, and discusses the implications for test score reporting and policy decisions based in whole or in part on the aggregate level relationships and discrepancies identified.…

This study analyzes the ways in which school boards assess and utilize evaluation data and their attitudes toward testing. Interviews with 27 school board members from 10 districts indicate that board members tend to rely on informal working knowledge over formal information, and on district administrators' judgments. Findings suggest that simple…

Discusses which kinds of data educators should respect and which they should reject. Asserts that most state accountability tests fail to produce the kinds of data that will improve teaching and learning. Teachers can get the data they need from their own instructionally useful classroom assessments. (WFA)

This paper gives an overview of the methods of moderation, or quality assurance and quality control, as they may be more widely known, that are used to enhance the quality of student assessment. The discussion is based on the educational systems of the United Kingdom but is applicable to assessment in other countries. Quality in assessment is seen…