Data were collected on 274 adults to investigate the efficacy of the Supports Intensity Scale (SIS) as a tool to measure the support needs of individuals with intellectual and related developmental disabilities. Findings showed that SIS scores contributed significantly to a model that predicted greater levels of support need. Moreover, scores from…

Teaching foreign languages at distance is now becoming widespread; so is the need for evaluating online language courses. This article discusses an example of a framework that was applied to evaluate an online English as a foreign language (EFL) course at a Middle Eastern university. The development of the framework investigated areas of interest…

This article explores children's participation in research, from the perspectives of researchers who have conducted research with children. Researchers' reports, gained using an email interviewing method, suggest that children's participation rights are particularly compromised when the potential child participants are considered vulnerable and…

As the number of large federal programs increases, so, too, does the need for a more complete understanding of how to conduct evaluations of such complex programs. The research literature has documented the benefits of stakeholder participation in smaller-scale program evaluations. However, given the scope and diversity of projects in multi-site…

The purpose of this study was to assess staff and client perspectives on the Internet-based Journey Mapping program evaluation tool. A drug court program was chosen for a case study research design. Six staff and 10 clients participated in interviews and observations, and also responded to a questionnaire. A staff survey provided additional data.…

This article evaluates an initiative to introduce assessment choice within a taught unit on an undergraduate healthcare programme as a means of addressing poor performance, especially for those students diagnosed with dyslexia. Students' perceptions of the assessment experience were sought via the use of two focus group interviews (n = 16). The…

When assessment tasks are set for students in universities and colleges, a common practice is to advise them of the criteria that will be used for grading their responses. Various schemes for using multiple criteria have been widely advocated in the literature. Each scheme is designed to offer clear benefits for students. Breaking down holistic…

Contemporary trends in social service delivery systems require human service agencies to engage in greater levels of advocacy to reform structures and protect programs that serve vulnerable populations. Objective: The purpose of this study was to develop an instrument to measure the policy advocacy behavior of nonprofit human service agencies.…

In this paper, we introduce various graphical methods that can be used to represent data in mixed research. First, we present a broad taxonomy of visual representation. Next, we use this taxonomy to provide an overview of visual techniques for quantitative data display and qualitative data display. Then, we propose what we call "crossover" visual…

Challenging behavior can create significant obstacles to academic and social progress for individuals in a school setting, particularly those with developmental disabilities. Functional assessments such as rating scales, ABC analyses, and functional analyses, are evidenced to be the most effective methods for identifying the maintaining variables…

Creating surveys is a common task in evaluation research; however, designing a survey instrument to gather average group response data that can be interpreted in a meaningful way over time can be challenging. When surveying groups of people for the purpose of longitudinal analysis, the reliability of the result is often determined by the response…

This article considers the underlying assumptions related to the use of random assignment in educational research and evaluation; more specifically, the ability of random assignment to create similar comparison groups for the purpose of determining the effectiveness of educational programmes. In theory, randomly assigning individuals to comparison…

This article describes the design and evaluation approaches to address the complexity posed by systems change initiatives. The role of evaluations in addressing the following issues is briefly reviewed: moving from strategic planning to implementation, impacts on system-level coordination, anticipated timeline of impact, and individual level…

Scores are the most visible and widely used products of a testing program. The choice of score scale has implications for test specifications, equating, and test reliability and validity, as well as for test interpretation. At the same time, the score scale should be viewed as infrastructure likely to require repair at some point. In this report…

Noting that there has been extensive discussion of the relation of evaluation to: (1) research; (2) explanations (a.k.a. theory-driven, logic model, or realistic evaluation); and (3) recommendations, the author introduces: (4) prediction. He advocates that unlike the first three concepts, prediction is necessarily part of most kinds of evaluation,…