This study explored motivation and engagement among North American (the United States and Canada; n = 1,540), U.K. (n = 1,558), Australian (n = 2,283), and Chinese (n = 3,753) secondary school students. Motivation and engagement were assessed via students' responses to the Motivation and Engagement Scale-High School (MES-HS). Confirmatory factor…

Research methods teaching in psychology is pivotal in preparing students for the transition from student as learner to independent practitioner. We took an action research approach to re-design, implement and evaluate a module guiding students through a programmatic and pragmatic research cycle. These revisions allow students to experience how…

This article considers various approaches to consulting primary pupils about mathematics. This is done first through a literature review and second by drawing on our experience of designing and piloting pupil consultation in collaboration with staff in one primary school. Our concern is with the utility and drawbacks of the methods used rather…

The research assessment framework is an unstable reality in many countries. While few would disagree that there is a need to measure and reward research excellence, there has been little investigation of how assessment mechanisms relate to knowledge itself. With a focus on the arts and humanities and writing from an Australian perspective, this…

Quantitative approaches to defining and measuring quality in early childhood education and care (ECEC) have provided a key platform for policy development. Yet their strengths and limitations as informants of high-quality ECEC have not been tested. In this study we examine two sources of quantitative data collected over a five-year period for 74…

The NEAIR 2015 Conference Proceedings is a compilation of papers presented at the Burlington, VT, conference. Papers in this document include:(1) Strategies to Analyze Course and Teaching Evaluation Data (Kati Li); (2) Using a Mixed Methods Approach to Assess a Leadership Mentoring Program (Betty Harper); (3) Flagship Institutions and the Struggle…

The process of constructing assessment scales for performance testing is complex and multi-dimensional. As a result, a number of different approaches, both empirically and intuitively based, are open to developers. In this paper we outline the approach taken in the revision of a set of assessment scales used with speaking tests, and present the…

Reliability captures the influence of error on a measurement and, in the classical setting, is defined as one minus the ratio of the error variance to the total variance. Laenen, Alonso, and Molenberghs ("Psychometrika" 73:443-448, 2007) proposed an axiomatic definition of reliability and introduced the R[subscript T] coefficient, a measure of…

With its critical assessments of scientific evidence on the effectiveness of education programs, policies, and practices (referred to as "interventions"), and a range of products summarizing this evidence, the What Works Clearinghouse (WWC) is an important part of the Institute of Education Sciences' strategy to use rigorous and relevant…

Creating surveys is a common task in evaluation research; however, designing a survey instrument to gather average group response data that can be interpreted in a meaningful way over time can be challenging. When surveying groups of people for the purpose of longitudinal analysis, the reliability of the result is often determined by the response…

The "U.S. News & World Report" (USNWR) rankings have become the "gold standard" of the college ranking business. College and university presidents proclaim that these rankings are not a measure of the quality of their institutions and that they do not pay attention to the rankings, but, in fact, institutions are very…

The Structured Observation System (SOS) is a data collection method developed to document changes in the communication behaviours of children identified with speech and language delays. The system employs a rating scale which reflects the occurrence of communication behaviours as well as the amount of assistance needed for behaviours to occur.…

Over 200 published and unpublished studies on Goal Attainment Scaling (GAS), currently a popular outcome evaluation technique in the social sciences, were critically reviewed. While the evaluative utility of GAS is questionable, its usefulness as an educational and intervention technique seems good. (Author/JKS)

A study was designed to test ordinal and interval properties of rating scales, similar to those commonly employed in evaluation research. The analysis was based on data generated by the use of paired comparisons and direct scales. The conclusion was reached that such rating scales appear to possess metric properties. (Author/LMO)

In 2006, the Bill & Melinda Gates Foundation launched the Early Learning Initiative (ELI) to improve the school readiness of Washington State's children through three main strategies: (1) development of high-quality, community-wide early learning initiatives in two communities; (2) enhancement of statewide systems that support early…