Multiple matrix sampling is a data collection technique that ensures accuracy and efficiency in group performance. It has been widely used in large-scale curriculum evaluation since the 1980s. However, the design does not always fully embrace the dynamics of local evaluation demands. The purpose of this study is to introduce a modified matrix…

This study examined a model of assessment that could be applied nationally for Year Twelve Vocational Education and Training (VET) subjects and which could yield both a differentiating score and recognition of competence. More than fifty colleges across all states and territories of Australia field-tested the approach over one school year. Results…

Although there are many reasons to evaluate training and development (T & D) programs, it is often time-consuming and expensive to do so. However, evaluations can be conducted by an auditing approach. The auditing approach to evaluating T & D offers three advantages. Auditing is quicker and less expensive than traditional methods, and it uses a…

The second of two related pamphlets, this guide describes how to design an outcome study and outlines procedures for collecting outcome data. After an introduction that delineates the purpose of the two-part series, the pamphlet is divided into four major sections. The first section explains how to select a cost-outcome analysis. The next three…

This study examined the appropriateness of the use of criterion referenced tests as a means of controlling an individual student's advancement to the next level of instruction or retention in the current unit in the PLATO Air Force Base Computer-Based Education project at Chanute. The study was also concerned with program evaluation, which…

There is plentiful discussion about the importance of accountability, but much needs to be done to translate it into a manageable and credible system of ongoing feedback. In this book, evaluative inquiry is used in a way that balances attention between the investigation process and its purpose. The book is divided into three parts. Following an…

Due to the high stakes that my be attached to placement decisions, it is imperative that the placement process be as solid and defensible as possible. An integral part of the placement process is the identification and use of cut scores, the point(s) on the score scale that classify students into adjacent categories for placement decisions. This…

This paper argues that many social validity processes in applied behavior analysis are actually measuring consumer satisfaction and not the habilitative validity of goals, procedures, or outcomes. The term "habilitative validation" is proposed to replace social validity, and use of more objective assessment methods is encouraged.…

Instruction and learning are increasingly based on competencies, causing a call for assessment methods to adequately determine competency acquisition. Because competency assessment is such a complex endeavor, one single assessment method seems not to be sufficient. This necessitates Competency Assessment Programs (CAPS) that combine different…

Three studies identifying the characteristics of program submittals approved by the Joint Dissemintion Review Panel were examined. Between 1978-1985, 358 demonstration programs were submitted. For each of these years, between 51 percent and 83 percent of the submittals were approved. In this study, the submittals were reviewed on the basis of the…

Explores the idea of quality, what it means to educators (student affairs professionals in particular), and the role assessment plays in measuring quality. Examines how assessment is used within Total Quality Management to measure quality from a customer perspective; compares such assessments to traditional evaluative methods. (RJM)

Citing the signaling and charged use distinction, examines federal expectations and need for evaluation data and extent of local capabilities to meet those expectations when secondary/transition model demonstration projects, funded by the Office of Special Education and Rehabilitation Services, were obligated to improve amount, quality, and use of…

The term "pilot study" has been used over the years to describe the evaluation of the many elements involved in deciding whether a proposed condition should be added to a newborn screening (NBS) panel, and until recently, was unilaterally used to describe the evaluation of the assay to be used before the condition was officially adopted by a state…

Schools throughout the country are now encouraged to implement school-wide positive behavior support (PBS) procedures as a way to improve their behavioral climate, safety, and social culture. Research is needed to determine (a) the extent to which schools already use school-wide PBS, (b) if training and technical assistance efforts result in…

This paper describes the development of an instrument--The Reflective Supervisor Questionnaire (RSQ). The RSQ maps the domain of research supervisory practice as a facilitative process involving educational tasks and activities. It is designed to assist research supervisors explore, by means of self-reflection and reflection on feedback from…