Principals know that effective teachers are the greatest school-based contributors to improved student outcomes. What is not always clear is how principals can help teachers adapt their instructional practices to the increasingly diverse learning styles they find in their classrooms. Teacher evaluation practices are typically not seen as a tool…

Working under classical test theory (CTT) and item response theory (IRT) frameworks, this study investigated psychometric properties of the Revised Purdue Spatial Visualization Tests: Visualization of Rotations (Revised PSVT:R). The original version, the PSVT:R was designed by Guay (1976) to measure spatial visualization ability in…

Government policies designed to redress social inequality are often evaluated by qualitative methods, which prevents the establishment of a causal relationship between policy objectives and outcomes. Social programmes to broaden participation in higher education have been a feature of government policy in Europe, the US and Australia during the…

This study explores the utility of a dual-factor model of mental health in which the concepts of mental illness and mental wellness are integrated. Life satisfaction, emotional symptoms, personal adjustment, and clinical symptoms were assessed with a sample of 240 college students. Participants were organized into four groups based on levels of…

The structure of two-tier testing is such that the first tier consists of a multiple-choice question and the second tier requires justifications for choices of answers made in the first tier. This study aims to evaluate two-tier tasks in "proportion" in terms of students' capacity to write and select justifications and to examine the effect of…

This chapter features a recent conversation with Dr. Arnold J. Love, a long-time proponent of internal evaluation and one of the most cited internal evaluation authors. In 1983, Love edited the first issue of "New Directions for Program Evaluation" on the topic of internal evaluation. He is the author of the book "Internal…

The author regards development of Australia's ill-fated Research Quality Framework (RQF) as a "live experiment" in determining the most appropriate approach to evaluating the extra-academic returns, or "impact," of a nation's publicly funded research. The RQF was at the forefront of an international movement toward richer…

An 18-item, multiple choice, 2-tiered instrument designed to measure understanding of the learning cycle (ULC) was developed and field-tested from the learning cycle test (LCT) of Odom and Settlage ("Journal of Science Teacher Education, 7", 123-142, 1996). All question sets of the LCT were modified to some degree and 5 new sets were…

It is familiar in the world of systems building that funders start out saying they are not particularly interested in attribution, only to later begin using words like "prove" and "impact." Boards begin by asking for intelligent reflection from the 30,000-foot level and then suddenly want to know how many more children are ready for school.…

Are the five states that are participating in the Great Start project, in fact, off to a Great Start? The simple answer from a casual read of this excellent case study appears to be "yes." Any early learning initiative that begins with a scientific evaluation is off to a great start. Sadly, some public and private funders have begun early learning…

An accurately calibrated item bank is essential for a valid computerized adaptive test. However, in some settings, such as occupational testing, there is limited access to test takers for calibration. As a result of the limited access to possible test takers, collecting data to accurately calibrate an item bank in an occupational setting is…

Instrument choice is a crucial part of evaluation of professional development programmes. The use of multiple evaluation methods helps in triangulation, and offers insight into the developmental sequence involved in the changes in teacher beliefs and practice. Most current instruments are self-contained and not designed for use in conjunction with…

Evaluations that combine social science and law have tremendous potential to illuminate the effects of governmental policies and yield insights into how effectively policy makers' efforts achieve their aims. This potential is infrequently achieved, however, because such interdisciplinary research contains often overlooked substantive and…

Giving students detailed feedback about the strengths and weaknesses of their work, with suggestions for improvement, is becoming common practice in higher education. However, for many students, feedback seems to have little or no impact, despite the considerable time and effort put into its production. With a view to increasing its effectiveness,…

Various applications of item response theory often require linking to achieve a common scale for item parameter estimates obtained from different groups. This article used a simulation to examine the relative performance of four different item response theory (IRT) linking procedures in a random groups equating design: concurrent calibration with…