Items on test score scales located at and below the Proficient cut score define the content area knowledge and skills required to achieve proficiency. Alternately, examinees who perform at the Proficient level on a test can be expected to be able to demonstrate that they have mastered most of the knowledge and skills represented by the items at…

In large-scale assessments, such as state-wide testing programs, national sample-based assessments, and international comparative studies, there are many steps involved in the measurement and reporting of student achievement. There are always sources of inaccuracies in each of the steps. It is of interest to identify the source and magnitude of…

Proposes a process approach to validity that addresses assessment validation in the context of high-stakes assessment. This approach includes a test evaluator or validator who considers the perspectives of five stakeholder groups at four different stages of assessment maturity in relation to six aspects of construct validity. Illustrates each…

A response, by Carlson, to the National Commission on Excellence in Education's report proposes establishment of an independent agency. This entity, in conjunction with the National Assessment of Educational Progress, would define common content domains, develop calibrated normed item banks, and develop content referenced reporting systems. (DWH)

An example application of portfolio assessment was developed and the model and estimates of reliability derived from the literature were then used to estimate the characteristics of an operational large-scale portfolio assessment program. Costs were estimated to put results in a realistic context. (SLD)

Provides a general framework for examining the consequences of assessment programs, especially statewide programs that intend to improve student learning by holding schools accountable. The framework is intended for use with programs using performance-based tasks but can be used with programs using traditional item formats as well. (SLD)

Three statewide assessment programs in Connecticut developed in response to the State Board of Education's goals and objectives are described. These include: (1) the Connecticut Assessment of Educational Progress; (2) the Educational Evaluation and Remedial Assessment Program; and (3) the Connecticut Mastery Testing Program.

In 1982, Lansing (Michigan) Public Schools took the stance that their low Michigan Educational Assessment Program (MEAP) scores were not reflective of what their students really knew and that, with some short- and long-range planning, scores would improve dramatically. The districtwide effort is briefly described here. (BW)

Addresses issues in evaluating the consequences of assessment programs that are developed to hold schools accountable to state standards. Proposes a validation study to obtain consequential evidence for state assessment and accountability programs that includes a validity argument, propositions that follow from the validity argument, a definition…

If annual performance assessments are to yield results that can be compared from year to year, many technical problems must be addressed. It is essential that tests to be equated measure the same construct. Methods of equating performance assessment scores, ways of equating system assessments, and standard setting are discussed. (SLD)

State and local policies for disseminating information to parents about statewide educational assessments were studied in a survey of 41 state program directors. Two studies in Michigan examined state policies in 201 districts and the degree to which 105 parents understood test results. Implications for information dissemination are discussed.…

Eight criteria developed by the National Forum on Assessment (Washington, DC) as guidelines for evaluating existing and proposed assessment systems at any level are listed. Criteria call for clear definitions and fair assessments to assist educators and policymakers in improving instruction. Continuous review and improvement are recommended. (SLD)

Proposed an accountably model that addresses the challenges of allowing school districts to choose the specific strategies they use to measure student performance and evaluated this model using data from multiple sources for all school districts in Florida. Findings identify three strategies that would be useful for this type of accountability…

The use of performance assessments in accountability programs is discussed. Performance assessments have the potential to measure important objectives not easily measured by multiple-choice tests. Nevertheless, they are not suitable for every purpose, and their use should not be oversold. Many psychometric issues remain to be resolved. (SLD)

Results are presented from a study of portfolio use for large-scale assessment in the Pittsburgh (Pennsylvania) public schools that are more encouraging for the use of this form of assessment than many other studies have been. Requirements for the psychometric integrity of portfolio assessment are discussed. (SLD)