The necessity to evaluate professional development has become more pressing for districts in a time of increased accountability. A number of empirical studies had shown that it was difficult to measure the effects of professional development, especially its effect on transferring practice and student achievement. The purpose of this study was to…

Classification evaluation metrics are often used to evaluate adaptive tutoring systems-- programs that teach and adapt to humans. Unfortunately, it is not clear how intuitive these metrics are for practitioners with little machine learning background. Moreover, our experiments suggest that existing convention for evaluating tutoring systems may…

Research Findings: The Early Childhood Environment Rating Scale, Revised (ECERS-R) is widely used, often to evaluate whether preschool programs are of sufficient quality to improve children's school readiness. We examined the validity of the measure for this purpose. Item response theory (IRT) analyses revealed that many items did not fit together…

The web is playing a central role in distance education. The word "usability" is usually synonymous with functionality of the system for the user. Also, usability of a website is defined as something that can be used by a specific group of people to carry out specific objectives in an effective way, with efficiency and satisfaction.…

Evaluators know they are supposed to identify and engage with stakeholders. What happens when the client has a very narrow concept of the meaning of evaluation? What happens when the primary stakeholders, including the client, disappear just as the evaluation gets started? First, it is important to acknowledge the challenge, then develop a…

Each year a great many evaluations are conducted of international development efforts around the world. These development evaluations study projects, programs, country-wide portfolios, policy reform efforts, and other topics of interest to funders, governments, program managers, and other involved stakeholders. Although some of these evaluations…

Contradictory findings from "well-implemented" rigorous evaluations invite researchers to identify the differences that might explain the contradictions, helping to generate testable hypotheses for new research. This panel will examine efforts to ensure that the large number of local evaluations being conducted as part of four…

This paper describes a platform for administering questionnaires on smart-phones and tablets. The project arises from the need of acquiring data for monitoring the outcomes of different homecare interventions. First a model has been defined for representing questionnaires, able to support adaptivity in the dialog with the user and enforce some…

Over the last decade, teacher evaluation has moved onto center stage in efforts to strengthen schooling. In this article, we address the question of whether focusing on this administrative process is likely to accomplish what reformers hope. We answer that question by examining the available evidence, both direct and indirect. We deepen the…

This article addresses the leadership preparation line of inquiry developed in the past decade by the University Council for Educational Administration/Learning and Teaching in Educational Leadership Special Interest Group Taskforce on Evaluating Leadership Preparation Programs, and it particularly addresses the series of survey instruments…

This article presents strategies for using two types of essay-writing rubrics in a developmental English class of students transitioning into college-level writing. One checklist rubric is student-facing, designed to serve as a guide for students throughout the writing process and as a self-assessment tool. The other checklist rubric is…

In 2006, our School of Management began the serious path of assessing both the "hard skills" (such as accounting, finance, and strategy) and the "soft skills" (such as leadership, team work, and ethics) of our MBA Program. The data generated from examining the "soft skills" that we want students to learn within our…

This article describes the development, implementation, and systematic evaluation of a public health pedagogy course for first-time graduate student instructors in a Health Behavior doctoral program at a Midwestern School of Public Health. The pedagogy course focused on intensive pedagogical training in the first 8 weeks of a 16-week semester and…

This study investigated the relation between the easyCBM Benchmark Assessments in both mathematics and reading and the Smarter Balanced assessment, widely adopted across the United States. Data for the study were obtained from a convenience sample of approximately 1,000 students per grade in grades 3-8 provided by two school districts in the…

Because data access may be perceived by principals as overwhelming or irrelevant rather than helpful (Wayman, Spikes, & Volonnino, 2013), data access does not guarantee effective data use. The data-based decision making literature has largely focused on teacher use of data, considering less often data-based organizational improvements for the…