Creating surveys is a common task in evaluation research; however, designing a survey instrument to gather average group response data that can be interpreted in a meaningful way over time can be challenging. When surveying groups of people for the purpose of longitudinal analysis, the reliability of the result is often determined by the response…

This study explores the psychometric properties of three instruments: a semi-structured interview, a questionnaire and a sorting task. The central question is which instrument is most suitable to investigate the goal orientations of students in competence-based pre-vocational secondary education. The questionnaire proved most accurate. The…

The body of research relating to assessment in education suggests that professional developers and seminar administrators have generally paid little attention to evaluation procedures. Scholars have also been critical of evaluations which use a single data source and have favoured the use of a multiple method design to generate a complete picture…

International comparisons in educational achievement and economic performance have spurred studies on the East Asian learner. In this context the cultural perspective on the Chinese learner has gained currency. This paper examines how the interaction of cultural, social and structural forces shape the changing patterns of diversity among Chinese…

Conducted a systematic review of randomized controlled trials of the administration of human albumin in critically ill patients. Findings raised serious concerns about the safety of an intervention that has been widely used in health care around the world. Findings illustrate the importance of systematic reviews in health care and other areas of…

This paper explains the principles and procedures of second-order theoretical analysis of observation data. The second-order theoretical procedure is illustrated by analysis of the student-teachers seminar on the subject of the Holocaust, focusing on dilemmas of Holocaust survivors. Analysing observational data allows two distinctive method of…

Studied the use of prior knowledge state assessment for enhancing learning through a series of experiments involving college students (n=112, n=1,159, n=1,081). Results show that beginning students are especially willing to use prior knowledge state assessment and appear to benefit more from its use. (SLD)

After describing the historical development of performance indicators in higher education and the illustrations that they provide for Goodhart's law, the paper discusses the difference between outcome and process indicators. It is suggested that, as long as the latter refer to underlying processes, and not to those immediately accessible, they can…

Demonstrates the use of converging evidence in examining the effects of class size reduction on academic achievement. Estimates derived from three different types of evidence is mutually supportive in this instance, suggesting that the effect of class size reduction from 24 to 15 produces modest, but lasting, increases in academic achievement.…

Reports on the first round of inspection by the Office for Standards in Education (England) of providers of postgraduate certificates in education (PGCE) for secondary school mathematics. Almost three-quarters of the providers evaluated in these 21 reports were judged to be good or better, but problems were found with the consistency of the OFSTED…

Examined the usefulness of British Office for Standards in Education (OFSTED) reports for educational improvement. After a pilot examination of 21 OFSTED reports, examined the scalar judgments of 11 reports in detail. Findings indicate that the inspection reports are weak and questionable products, not a good base for developing school improvement…

A study is reported of the use of a personal journal as a tool for transferring learning from the training room to the workplace. The targeted learning event was an English for Communication training programme. This programme was an intensive four-day course that grouped together participants from the non-UK sites of the aircraft manufacturer…

Explores what it would mean to "spread best practice" in educational measurement and considers lessons from the history of medicine and other scientific disciplines that are relevant to the development of educational theory and practice. Makes the case that these lessons point toward the use of less complex statistical tools and the collection and…

Review teams tested the systematic review procedures and principles developed under the Campbell Collaboration Fourteen review teams selected topics for intervention reviews in social policy, education, and criminal justice. Review protocols gave criteria for the extensive research literature search. Randomised Controlled Trials were selected.…

Site visits by peers of those being visited are discussed as part of an educational indicator system. The experience of the WASC in California in using self-study and site visits in school accreditation for over six years is described, and limitations of the procedure are discussed. (SLD)