The Programme for International Assessment of Adult Competencies (PIAAC) will establish technical standards and guidelines to ensure that the survey design and implementation processes of PIAAC yield high-quality and internationally comparable data. This document provides a revised version of the technical standards and guidelines originally…

Although a number of investigators have adopted the O'Carroll et al. (1996) nomenclature and applied it in their studies, and others have acknowledged its role in highlighting the need for clarification of terms, the nomenclature has not been widely used in the research and clinical communities. The rationale behind the rebuilding of the O'Carroll…

This guide provides evaluators interested in new methods with a framework for determining the feasibility, utility, and effectiveness of the methods in field settings. To accomplish this intent, the body of this guide contains discussions of five checklists. Three of the checklists are to be used before a trial to determine the feasibility of one…

The purpose of this study was to develop an instrument, the "Job Seeking Self-Efficacy Scale," to measure perceived self-efficacy in job-seeking activities. The construction of the instrument, which incorporated tasks that have been determined to be important in job seeking for individuals with disabilities, was based on Bandura's theory of…

In order to determine the extent to which the LOGO programming language can be used as a reinforcer for general problem solving ability, this field study used a production theory approach to problem solving as a conceptual model, and then translated the model into a LOGO oriented framework. The methodology tested the use of an algorithm in a…

This document, the second of two volumes, completes the report of a Lilly Endowment, Inc. funded project whose major objective was to establish a process for both teachers and students to be involved in the field testing or evaluation of microcomputer software. Workshops were held in nine Indiana school corporations where more than 2,300 students…

This discussion of formative evaluation as part of the instructional design process focuses on developmental testing and expert review. A review of the literature helps define each approach, research on formative evaluation is reviewed, and 37 references are provided. (LRW)

The purpose of this monograph is twofold: (1) to describe the advantages and disadvantages of mail questionnaires as survey research instruments, and (2) to provide guidelines for constructing and utilizing mail questionnaires with a view to maximizing response rates and minimizing response biases. Construction of an effective mail questionnaire…

This report summarizes the activities of the first year of a 2-year Lilly Endowment, Inc. sponsored project, which funded nine Indiana school corporations to select and field test current microcomputer software, and presents 53 critical software evaluations based on information gathered from teachers and students. Information provided by the…

Schools are in the midst of serious reform as they attempt to meet the requirements of the No Child Left Behind Act and make adjustments that will positively impact students? academic lives. Yet, to accomplish these outcomes, schools need help, and state departments of education and local school districts are obligated to provide such assistance.…

Describes study that compared teacher panel reviews of educational software to field test reports to determine the levels of agreement between the two evaluation types. Methods of evaluation are discussed, the York Educational Software Evaluation Scales (YESES) are explained, and the results of the study of 36 software packages are presented.…

Describes a study conducted to determine prevalence of educational software field testing by producers, number of teachers and students participating, evaluation criteria used, whether documentation includes field test results, field test value, and other evaluation methods utilized during product development. Textbook versus software evaluation,…

This paper provides empirical data on two approaches to statistically equate scores derived from the direct assessment of writing. These methods are linear equating and equating based on the general polychotomous form of the Rasch model. Data from the Maryland Functional Writing Test are used to equate scores obtained from two prompts given in…

A review of the research literature on systematic instructional design indicates that few empirically supported guidelines exist for testing materials under development and for improving materials on the basis of feedback from potential learners. In an analysis of 17 textbooks on instructional design, eight specific aspects to be considered in…

Discusses highlights of a literature review on guidelines for formative evaluation of courseware and the development of a formative evaluation instrument by the Kanata High Technology Training Association (Ottawa). The eight dimensions of the resultant questionnaire are listed and a copy of the evaluation instrument is included. (MBR)