This paper illustrates the use of exploratory focus groups to inform the development of a survey instrument in a sequential phase mixed-methods study investigating differences in secondary students' career choice capability. Five focus groups were conducted with 23 Year 10 students in the state of New South Wales, Australia. Analysis of the focus…

As classrooms become increasingly diverse in higher education, educators are emphasising inclusive practices in teaching and learning to accommodate the needs of diverse learners. There is also an emerging need for an inclusive approach in assessment for accessibility, opportunity, relevance and engagement. This study, using design-based research…

This technical report is designed to provide researchers with an overview of the design and implementation of the Teaching and Learning International Survey (TALIS) 2013. This information is meant to supplement that presented in OECD publications by describing those aspects of TALIS 2013 that are unique to the United States. Chapter 2 provides…

In the context of intensifying accountability for academic work internationally, there are increasing pressures on individual supervisors, departments and universities to evaluate the quality of doctoral supervision. Existing evaluation tools are focused at departmental rather than individual level and are mostly quantitative. Evaluation for…

A study was conducted to design valid and reliable self-evaluation instruments for periodic evaluation of academic programmes of Bolgatanga Polytechnic in Ghana, using evaluation experts and relevant stakeholders of the polytechnic. This paper presents some of the challenges, including those of institutional support, the technical demands of…

This study reports on the development and evaluation of a rating tool to assess the scientific utility and cultural appropriateness of community-level indicators for application with Indigenous populations. Indicator criteria proposed by the U.S. Institute of Medicine were culturally adapted through reviewing the literature and consultations with…

This paper describes the process of designing and administering a sufficiently valid and reliable assessment instrument to measure the progress in attainment of adult learners studying numeracy, and discusses some of the inherent difficulties that were involved. The fieldwork took place during 2003-2005 and involved a sample of 34 teachers and 412…

In a survey of all PhD programs in psychology in the United States and Canada, the authors documented the quantitative methodology curriculum (statistics, measurement, and research design) to examine the extent to which innovations in quantitative methodology have diffused into the training of PhDs in psychology. In all, 201 psychology PhD…

The designing of tests has been a source of concern for test developers over the past decade. Various kinds of test forms have been applied. Among these are the fixed-form test, the adaptive test, and the testlet. Each of these forms has its own design. In this paper, the construction of test forms is placed within the general framework of optimal…

The application of mathematical programming techniques is extended to the construction of measurement instruments in generalizability theory. Key concepts in generalizability theory are explained and a description is given of: (1) the one-facet crossed design; (2) the two-facet crossed design; and (3) a two-facet nested design. The optimization of…

The seven articles of this special issue comment on the International Association for the Evaluation of Educational Assessment Reading Literacy Study conducted from 1989 to 1991 in 31 countries. Project design and test instruments are reviewed, and results from the Nordic countries are presented and explored. (SLD)

The process of constructing and validating a questionnaire for use in course evaluation in a teacher education program in Israel is described. (MSE)

The Vocational Interest Survey (VIS) is a set of six questionnaire scales for measuring vocational interest. It is designed for Australian users and is consistent with Holland's theory that there are six basic career categories. This paper discusses the development of the VIS and presents some technical data on the questionnaires. Items were…

This article is the first of a four part series of a study of Canadian high-school graduates' views on science-technology-society (STS) topics. It describes the research scope and methodology and discusses research issues associated with use of the specially constructed survey instrument, Views on Science-Technology-Society (VOSTS). (ML)

This document consists of two guides that were developed to assist small rural communities in northern Alberta (Canada) in conducting surveys. A community survey can be used to develop long- and short-range plans, define and solve problems, establish priorities, confirm public opinion, develop community support and stimulate action, and reveal new…