With the research reported here, we specifically aim to develop application products of scientific work independence instruments through science integrated learning (SIL) for various education levels (elementary schools, junior high schools, senior high schools, and universities). The SIL model was applied in learning to determine specific…

"Methods and Procedures in PIRLS 2016" documents the development of the Progress in International Reading Literacy Study (PIRLS) assessments and questionnaires and describes the methods used in sampling, translation verification, data collection, database construction, and the construction of the achievement and context questionnaire…

Although International Association for the Evaluation of Educational Achievement-pioneered international large-scale assessment (ILSA) of education is now a well-established science, non-practitioners and many users often substantially misunderstand how large-scale assessments are conducted, what questions and challenges they are designed to…

Current pressures in higher education around student employability are driving new initiatives for change. Assessment is also a topic of debate, as it is a key driver of student behaviour, yet often falls behind other metrics in national surveys. In addition, increasing focus on digital literacies is catalysing new appreciations of what emerging…

This chapter provides an overview of sampling methods that are appropriate for conducting online surveys. The authors review some of the basic concepts relevant to online survey sampling, present some probability and nonprobability techniques for selecting a sample, and briefly discuss sample size determination and nonresponse bias. Although some…

This article provides a broad overview of the definition of web-based surveys examining some of the benefits and burdens related to using the Web for data collection. It draws upon the experience of two years of data collection on 10 university campuses demonstrating that there are noticeable differences in the speed with which web-based surveys…

This paper examines two empirical studies that used online surveys to collect data to measure satisfaction in job training and workforce development. A description of each study, findings related to response rate, the processes used in online survey development and implementation, as well as recommendations for the future use of online surveys…

The authors propose using cluster analysis to develop a branching logic that would allow the adaptive administration of psychological instruments. The proposed methodology is described in detail and used to develop an adaptive version of the Halstead Category Test from archival data. (SLD)

This article is the fourth contribution to a research methods series dedicated to getting "good results" from survey research. The intent of this article is to elaborate the selection and design decisions one must address when considering the use of a telephone survey as an alternative to the traditional postal survey that collects respondent data…

In connection with the development of item pools for the Navy's experimental Computerized Adaptive Testing (CAT) system, items in five different content areas (General Science, Paragraph Composition, Word Knowledge, Math Knowledge, and Arithmetic Reasoning) have been calibrated using item response theory (IRT) methodology. Operational Armed…

Microcomputer versions of three commonly used cognitive style measurement instruments are described and demonstrated: the Leveling-Sharpening House Test (LSHT) (Santostefano, 1964); Lowenfeld's Successive Impressions Test I (SIT-I) (1945); and the Group Embedded Figures Test (GEFT) (Witkin, Oltman, Ruskin, and Karp, 1971). At present, many…

This paper provides an overview of the entire process necessary to developing a university-wide web survey, from the community-building process for creating support for the survey and determining the questions, to the specific tasks necessary for designing and administering an efficient web product. (Contains 17 tables.)

During the past few years, several Harvard paper surveys were converted to Web surveys. These were high-profile surveys endorsed by the Provost and the Dean of the College, and covered major portions of the university population (all undergraduates, all graduate students, tenured and non-tenured faculty). When planning for these surveys started in…

This article is the first of a research methods series dedicated to getting good results from survey research. In this series, "good results" is a stenographic term used to define surveys that yield accurate and meaningful information decision makers can use with confidence to identify current practices that merit continuation and to create or…

Different formats for four types of research items were studied for ease of computer data entry. The types were: (1) numeric response items; (2) individual multiple choice items; (3) multiple choice items with the same response items; and (4) card column indicator placement. Each of the 13 experienced staff members of a major university's Data…