As medical education research advances, it is important that education researchers employ rigorous methods for conducting and reporting their investigations. In this article we discuss several important yet oft neglected issues in designing experimental research in education. First, randomization controls for only a subset of possible confounders.…

This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…

This guide is designed to help researchers make sure that their research reports include enough information about study measures so that readers can assess the quality of the study's methods and results. The guide also provides examples of write-ups about measures and suggests resources for learning more about these topics. The guide assumes…

For this evaluation of a multicultural education unit, Staged Innovation Design, which allows for experimental group posttest scores to be compared to control-replication group pretest and posttest scores to ascertain instructional effectiveness, was modified by adding a simultaneous pretest for both groups to control for threats to internal…

The Computer Attitude Scale (CAS) is a Likert-type instrument consisting of 30 items which present positively and negatively worded statements of attitudes toward computers and the use of computers. The CAS was subjected to three validation studies. The first study examined the reliability and factorial validity of the CAS and its subscales. The…

Two instruments and instructional activities were pilot tested to determine if they could be used in a later evaluation study of a Domain of Cognition model, developed by Robert J. Stahl as an alternative to Bloom's Taxonomy. The model, intended to help educators more effectively plan for, implement, monitor, and evaluate instruction, was proposed…

Social desirability responding and effort justification were each studied for their effect on response shift as seen in retrospective pretest-posttest responses. The first study used a bogus pipeline induction (half the subjects were told their self-reporting could later be validated) before the self-report pretest. After experimental or control…

This study was designed to develop and validate an instrument to measure general attitudes toward research design and statistics for use with students in an undergraduate nursing research course. Personal feelings of anxiety or lack of competence in dealing with course material were also assessed. Evidence of construct validity was provided by the…

The development of a modified semantic differential measure of school-related attitudes of grades 3-6 children is described and its validation involving 99 children is reported. Each of the four scales of this measure, Attitude Toward-School, -Language Arts, -Teachers, and -Arithmetic, was found to be unidimensional. Internal consistency estimates…

The purpose of this study was to investigate the effectiveness of computer-aided instruction as compared with the traditional lecture method of cognitive learning of new curriculum materials. It was hypothesized that students instructed by the computer-aided instruction method would gain higher knowledge of the subject matter in terms of cognitive…

This paper examines the development of the "Comfortability Scale in Special Education." This 44-item self-evaluation instrument measures special education teachers' perceptions of "comfort" (self-confidence) with their ability to use pertinent knowledge and skills. Each item is rated on a seven-point Likert-like scale. Two…

The effectiveness of an Education Consolidation Improvement Act Chapter 1 program was studied in a large urban school district. A common problem in evaluating remedial programs is that pretest/posttest achievement gains often indicate the effects of the entire curriculum, rather than those specific to the remedial class. In this district, over…

A study examined the use of cloze procedure as a measure of learning from content instruction. Subjects were 35 physician assistant (PA) students in a cancer prevention course and 31 education students (ED) enrolled in reading instruction courses. Cloze passages were constructed from published selections on the reading process and occupationally…

The history of test coaching has shown that positive benefits can be produced from short-term orientation, practice, and drill. Coaching on the Scholastic Aptitude Test (SAT) has been especially scrutinized for efficacy and has shown modest program effects, despite the limited scope and duration of such programs. The present investigation expands…

Discusses issues relating to the reliability, validity, utility, and information value of unobtrusive testing of library reference services; provides suggestions for practical applications of these criteria; applies study findings to library decision making and planning; and identifies topics for further methodological refinement. (Author/CLB)