We interrogate the opportunities and challenges of using mixed methods (MM) within a developmental evaluation (DE) context by drawing on two illustrative cases that investigated educational change in Canada. Methods: Multi-case design and cross-case analysis, with a focus on examining common patterns across the two cases, enabling new ways of…

Calls for increased monitoring and evaluation of education policies and practices have not, so far, included widespread and consistent assessments of the inclusiveness of education settings. Measuring inclusion in education has proven to be a challenging exercise, due not only to the complexity and different uses of the concept, but also to its…

A multi-disciplinary academic unit at a Canadian university completed an evaluation of course syllabi used in its undergraduate programmes over the previous five years. This paper examines the reasons for the evaluation, the processes employed to collect and analyse the data, and how the results will be incorporated into the next steps of the…

Background: Individuals with intellectual and developmental disabilities (IDD) experience high rates of physical and mental health problems; yet their health care is often inadequate. Information about their characteristics and health services needs is critical for planning efficient and equitable services. A logical source of such information is…

This study, through multilevel analyses of the data of four English-speaking nations (i.e., Canada, England, New Zealand and the United States) from the Progress in International Reading Literacy Study (PIRLS) 2001 database, investigated the relationship between teachers' uses of various types of classroom assessments and their fourth-graders'…

In attempting to use a realistic evaluation approach to explore the role of Community Parents in early parenting programs in Toronto, a novel technique was developed to analyze the links between contexts (C), mechanisms (M) and outcomes (O) directly from experienced practitioner interviews. Rather than coding the interviews into themes in terms of…

In the fall of 2003, Teaching Support Services (TSS), a department at the University of Guelph, was approached by a faculty member in the department of food sciences. Professor Art Hill was interested in seeking support in systematically assessing the department's undergraduate curriculum and using that assessment to trigger further improvement of…

Background: Coaches and physical educators must obtain valid data relating to the contribution of each of their players in order to assess their level of performance in team sport competition. This information must also be collected and used in real game situations to be more valid. Developed initially for a physical education class context, the…

Efficiency scores are determined for Canadian universities using both data envelopment analysis and stochastic frontier methods for selected specifications. The outcomes are compared. There is considerable divergence in the efficiency scores and their rankings among methods and specifications. An analysis of rankings, however, reveals that the…

Data on the intrinsic characteristics of an educational program are essential in pilot testing new programs in order to determine how successfully design components have achieved their intended purpose. At the outset of an evaluation of such data, it is necessary to define the evaluator's role and determine what intrinsic information will be…

Analyzes orchestral repertoire data as indications of musical taste. Collects data from 34 U.S. and Canadian symphony orchestras from 1982 through 1987. Summarizes and compares programing of 600 composers and 10,500 works. Reveals that Mozart was most frequently performed, and Beethoven was given most time. Shows relationship between student and…

Evaluative inquiry--systematically gathering and analyzing data for the purposes of judging program or innovation merit, worth or significance and/or supporting ongoing school-based decision making and problem solving--is an option available to educators that is not often used; this despite recent interest in action research and school-based…

This paper provides an overview of the data collection, analysis, and reporting system of the British Columbia Ministry of Education, a system that is intended to improve the results obtained by the school system. The background of the system is described, and how it is used to assist in school improvement is outlined. The system's success to date…

Throughout this era of greater educational accountability, assessment researchers have argued that large-scale comparative assessment data can enhance learning within and across systems of education and can foster reforms based on the practices of high achieving jurisdictions. Other researchers are less optimistic, warning that educational reform…

In January 1998, seven school boards amalgamated to form the Toronto District School Board, a board responsible for 600 schools. To deal with the complexities of the new entity, researchers have been using geographical information systems (GIS). GIS are computer-based tools for mapping. They store information as a collection of thematic layers or…