This guide explains the benefits of and procedures for constructing and administering criterion-referenced performance tests in vocational education programs. Addressed in the individual sections are the following topics: the rationale for using task performance measures in vocational education; the predictive validity and physical fidelity of…

This paper was written to help local level advocates in the human services understand and use statistical data from the U.S. Bureau of the Census. Because of budget cuts, difficult times are ahead for human services delivery. Advocates need to strengthen their technical skills. In the first section of the paper, two new programs of published data…

Aims to help instructors make more valid test questions, particularly multiple-choice ones. Emphasis is placed on multiple-choice questions to show the wealth of opportunities they offer for testing because of their uses, objectivity, and ease of grading. Discusses test scheduling, construction, and evaluation and follow-up. (CT)

This paper provides educators with a general perspective on computer literacy and an in-depth examination of the Computer Literacy Awareness Assessment conducted by the Minnesota Educational Computing Consortium (MECC). Addressing computer literacy as part of the ongoing use of computers in a classroom setting is identified as the most reasonable…

Provides an approach for selecting and evaluating both group and individually administered standardized tests of reading. Reviews considerations of the quality of test development; test content; test reliability and validity; and concerns of cost and time investment. Presents sample ratings of two common instruments. (RS)

Since research conclusions derived from inappropriate statistical methodologies can lack accuracy, the article describes a technique appropriate to the heterogeneity of special needs groups in which subjects are assigned to fairly homogeneous subgroups. The technique is related to research in reading with this population. (DB)

Addresses the use of subjective judgment in research that involves statistical/quantitative methods with regard to four aspects of quantitative research: (1) design; (2) preliminary analyses; (3) general analyses; and (4) specific analyses. (Contains 37 references.) (ASK)

Compares and contrasts standards and techniques of qualitative and quantitative usability testing methodologies. Focuses on ways technical communicators can ensure rigorous tests in terms of the validity and reliability of findings, defining criteria of validity and reliability for both quantitative and qualitative methods. Presents a list of…

This report was written to provide guidance in the development and evaluation of alternative instructional approaches that hold promise of improving instructional effectiveness. The main focus of the report is on how to identify and test interactive relationships between individual differences among learners and instructional conditions or…

This paper discusses Minnesota Multiphasic Personality Inventory (MMPI) data obtained from individuals exposed to chlorine dioxide in the workplace who developed Multiple Chemical Sensitivity Syndrome. The paper explores current research on chlorine dioxide exposed persons who were misdiagnosed on the basis of MMPI interpretations. Difficulties…

The main features of a multiple site, structured case study design are presented. The nature of explanatory patterns, how case study investigators pursue and recognize valid patterns, and how an analyst can apply the same logic to cross-site analysis are discussed. (Author/BW)

The article describes and critiques seven adaptive behavior instruments: Adaptive Behavior Inventory for Children, American Assocation on Mental Deficiency Adaptive Behavior Scale, Balthazar Scales of Adaptive Behavior, Children's Adaptive Behavior Scale, Comprehensive Test of Adaptive Behavior, Scales of Independent Behavior, and Vineland…

External and implementation factors and their potential threats to field test validity and the practical realities of the field testing process on results are discussed. External factors include site selection, negotiations, contracts, site monitoring, training, and type of product. Implementation factors include motivation, dependence on local…

Since the 1980s, composition studies have considered the steps to be taken before assessment: designing the test essay question. While large-scale assessment has little control over writing variables (such as students' learning styles, their reading ability, and their interpretation of the topic), the content or the topic of the writing prompt and…

This handbook is intended to help educational evaluators use still photography in designing, conducting, and reporting evaluations of educational programs. It describes techniques for using a visual documentary approach to program evaluation that features data collected with a camera. The emphasis is on the aspects of educational evaluation…