Licensure and certification decisions are usually based on a chain of inference from results of a practice analysis to test specifications, the test, examinee performance, and a pass-fail decision. This article focuses on the design of practice analyses and translation of practice analyses results into test specifications. (SLD)

Notes that researchers are often required to examine specific model under two different situations. Cites studies in which authors compared results descriptively without use of inferential statistics. Describes use of series of regression tests to compare two situations statistically. Gives example from recent study to illustrate technique.…

This article reviews issues in questionnaire design beyond the creation of standardized questions and basic data collection rules. The use of magnitude scales, the application of decision theory, and the use of a questionnaire framework that replicates how choices are made by respondents are among the new design approaches discussed. (SLD)

Describes the a-e-I-o-u program evaluation approach, a framework for organizing key evaluation questions that allows for many models of evaluation and/or methods of data collection. Evaluations by users of the approach have indicated that it provides a practical way to organize evaluation questions and collect appropriate data. (GCP)

Discusses the return-on-investment (ROI) process for determining the effectiveness of a training initiative in light of the organization's strategic plan for performance improvement. Describes data collection barriers and uses hypothetical deductive reasoning to overcome barriers and evaluate the effectiveness of an organization's training…

Over time, improvements in HIV/AIDS surveillance and service utilization data have increased their usefulness for planning programs, targeting resources, and otherwise informing HIV/AIDS policy. However, community planning groups, service providers, and health department staff often have difficulty in interpreting and applying the wide array of…

A key component to the new wave of performance-based pay initiatives is the use of student achievement data to evaluate teacher performance. As greater amounts of student achievement data are being collected, researchers have been developing and applying innovative statistical and econometric models to longitudinal data to develop measures of an…

With a focus on the use of technology when evaluating programs for Aboriginal people, this article explores the possibility of using visual and oral computer technology to enhance the incorporation of Aboriginal worldviews in program evaluation. The author situates Aboriginal worldviews, including methods of communication and transmission of…

Human resources are recognised as being key to the creation, commercialisation and diffusion of innovation. Among them, doctorate holders are not only the most qualified in terms of educational attainment, but also those who are specifically trained to conduct research. Not much is known however about their career and mobility patterns on the…

The coprincipalship has been suggested as an organizational structure that addresses the increasing workload and time demands of the principal as well as the shortage of qualified applicants for the position. This article presents the findings of a qualitative study of coprincipals in public and private schools in California, Illinois,…

SNAP/SHOT (System Network Analysis Program-Simulated Host Overview Technique) is a discrete simulation of a network and/or host model available through IBM at the Raleigh System Center. The simulator provides an analysis of a total IBM Communications System. Input data must be obtained from RMF, SMF, and the CICS Analyzer to determine the existing…

The process of dealing with real world problems often requires solutions that would not be totally acceptable in the world of "pure" scientific research. A systems analytic viewpoint demands that everything possible be done to define the constraints of the system and that the procedures used to construct a model out of imperfect data be specified.…

The objective of this research is to provide an outline of evaluation by objectives for a conference entitled Project Evaluation. As far as processes are concerned, this evaluation will result in a session-by-session evaluation form and transparencies to accompany the session-by-session evaluation form and to reinforce the main points under…

Once programs or projects have been planned (in terms of personnel, activities, and expected outcomes), it becomes most important to develop a method of collecting information relative to the implementation of the programs or projects. This process of determining if what is planned as a program or project is actually implemented is known as…

A description of the accountability instruments and procedures used in a three-year study of independent-living rehabilitation needs of the severly disabled is presented. Discussion of the problems encountered in using qualitative, restrictive quantitative, behavioral, and questionnaire or scaling accountability methods is presented. (Author)