Various strategies for optimizing the use of program evaluation information are recommended, based on a thorough evaluation of the literature. The recently revised "Program Evaluation Standards" (Joint Committee, 1994) are then reviewed point by point as regards sensitivity to these recommendations. It appears that the new standards…

Use of the bootstrap method in a canonical correlation analysis to evaluate the replicability of a study's results is illustrated. More confidence may be vested in research results that replicate. (SLD)

Research libraries are increasingly supplementing collection counts with perceptions of service quality as indices of status and productivity. The present study was undertaken to explore the reliability and validity of scores from the SERVQUAL measurement protocol (A. Parasuraman and others, 1991), which has previously been used in this type of…

The study investigated whether school administrators (n=128) implicitly perceive the "types" of evaluators proposed by Meltsner (1976) when they consider evaluative information. One simulated evaluation report was written to represent each evaluator, differentiated from one another by their norms, expectations, motivations, and training.…

Three criticisms of overreliance on results from statistical significance tests are noted. It is suggested that: (1) statistical significance tests are often tautological; (2) some uses can involve comparisons that are not completely sensible; and (3) using statistical significance tests to evaluate both methodological assumptions (e.g., the…

The SERVQUAL measure was developed by A. Parasuraman, L. Berry, and V. Zeithaml (1988) to measure perceptions of service quality, originally in the retailing sector. However, libraries and other educational institutions are also service providers. Librarians in particular have increasingly become interested in measuring quality of service as the…

The mission of the "Journal of Counseling and Development" (JCD) includes the attempt to serve as a "scholarly record of the counseling profession" and as part of the "conscience of the profession." This responsibility requires the willingness to engage in self-study. This study investigated two aspects of research…

Selected methods for evaluating the stability of research results empirically are described, especially with regard to multivariate analysis. It is critically important to evaluate the influences of sampling error on obtained results; statistical significance testing does not inform judgment regarding the probable replicability or the sampling…

This study was conducted to evaluate whether a brief self-description checklist may provide a viable method of quickly obtaining initial personality type information. The Personal Preferences Self-Description Questionnaire (PPSDQ) and the Myers-Briggs Type Indicator (MBTI) were administered to 420 college students, and PPSDQ item-response and MBTI…

Brinkmanship behaviors challenge the authority of a social system while trying to avoid, usually through the use of humor, the sanctions that would normally be provoked. This study investigated the validity and use of short scenarios portraying various teachers challenging policy in different ways as a strategy for measuring perceptions of these…

Web-based statistical instruction, like all statistical instruction, ought to focus on teaching the essence of the research endeavor: the exercise of reflective judgment. Using the framework of the recent report of the American Psychological Association (APA) Task Force on Statistical Inference (Wilkinson and the APA Task Force on Statistical…

Although methodological integrity is not the sole determinant of the value of a program evaluation, decision-makers do have a right, at a minimum, to be able to expect competent work from evaluators. This paper explores five areas where evaluators might improve methodological practices. First, evaluation reports should reflect the limited…