Western Governors University (WGU) is an online competency-based university in which students demonstrate content competence through a series of assessments. Assessments most often are performance-based or objective assessments that are developed in accordance with specific content objectives. Objective assessments generally assess lower-level…

This monograph is intended to assist educators faced with the task of selecting and developing sound writing assessment procedures. Provided are: (1) practical background information on direct writing assessment procedures, alternative approaches, time requirements, advantages and disadvantages of each assessment approach, and (2) identification…

The impact of item response theory (IRT) on the measurement practitioner is discussed, with a review of potential benefits. The complexity of IRT theory and procedures and the lack of robustness of IRT procedures to violation of assumptions must be recognized for the measurement practitioner to realize its advantages. (SLD)

Describes the collaborative process and the lessons learned when the staff of a family-literacy program and an evaluator worked together to design and implement a portfolio assessment that was used to collect program-evaluation information for the Even Start program over two years. Discusses opportunities to collaborate in the development of this…

A teacher appraisal instrument was developed and validated for a system of teacher evaluation in Rivers State (Nigeria). The developed Likert scale for teacher scoring was tested for 410 teachers evaluated by 16 headteacher evaluators. Initial findings suggest areas in which the appraisal process and instrument can be improved. (SLD)

A checklist of characteristics of effective mail questionnaires was developed that reflects some degree of consensus among experts in survey research and that can serve as a guide to novices designing a questionnaire. Journal and book sources of information about mail questionnaires were reviewed to yield 83 items in 7 categories that comprised…

This study reports the results of a survey sent to 67 metropolitan school district evaluators. The survey assessed past and anticipated conduct of cost analysis methods, as well as attitudes toward the use of these methods. The instrument used contained many items taken from a survey instrument used in a previous study of cost analysis methods at…

Development of a multistage dominant profile method for setting standards on complex performance assessments is detailed. The method grew from experiences with a judgmental policy-capturing procedure and an extended Angoff method. The design of an early adolescence English language arts assessment illustrates the complexity of decisions panelists…

Theory and implications for methods of assessing administrative performance in simulated exercises are presented. The rationale is given for the following: (1) developing simulated exercises; (2) measuring behaviors exhibited during the exercises; (3) training evaluators; (4) combining information across exercises; and (5) storing and retrieving…

The Department of Measurement, Statistics, and Evaluation (EDMS) at the University of Maryland is working to develop Master's degree programs that are oriented around developing assessment professionals for work in applied settings. Two fundamentally different sets of experiences are being developed: (1) assessment development, administration, and…

The Educational Testing Service is developing a new generation of teacher assessments--the Praxis Series: Professional Assessments for Beginning Teachers. The assessment series consists of three components. An academic skills component will assess the candidate's basic academic and enabling skills. Subject assessments will test the candidate's…

The seven articles of this special issue focus on theory and research related to survey methods and whether evaluators need information that is absent from the larger survey literature. These articles reflect the view that the considerations relating to good survey research apply also to using surveys in evaluation. (SLD)

The focus is on partitioning the evaluation of the consequences of assessment programs among the sponsors, developers, users, and reviewers of tests. Five parties that share responsibility are discussed: (1) the state legislature, (2) the state board of education, (3) the school district, (4) the test publisher, and (5) the measurement profession.…

In fall 2003, the Head Start Bureau began implementing the Head Start National Reporting System (NRS) to systematically assess the early literacy, language and numeracy skills of all 4- and 5-year-olds enrolled in Head Start. In addition to child progression on a designated set of outcomes during the year preceding kindergarten, the data will…

The feasibility of constructing test forms with practically equivalent cut scores using judges' estimates of item difficulty as target "statistical" specifications was investigated. Test forms with equivalent judgmental cut scores (based on judgments of item difficulty) were assembled using items from six operational forms of the…