This dissertation describes the process of creating a guidebook that developmental education administrators can use to build their capacity as leaders, learners, and program planners. The guidebook is the product of a qualitative study designed to better understand how community college administrators who have program planning responsibilities for…

The 2004/06 Beginning Postsecondary Students Longitudinal Study (BPS:04/06), conducted for the U.S. Department of Education's National Center for Education Statistics (NCES), collected information about the education and employment experiences of students in the two years following their first enrollment in postsecondary education. The primary…

This paper posits a taxonomy for categorizing issues that arise in the evaluation of Intelligent Tutoring Systems (ITSs). The taxonomy has three dimensions: Life Cycle of Evaluation, Research Issues, and Methodological Issues. The Life Cycle dimension has four levels: pre-experimental, laboratory study, field study, and initial operational test…

This report describes and evaluates the methods and procedures used for the field test of the Baccalaureate and Beyond Longitudinal Study (B&B:2000/01). The B&B:2000/01 field test included important changes from previous B&B surveys (conducted in 1994 and 1997) in its sample design and collection of data. The introductory chapter…

This chapter presents Hutchinson's Metamethodology, which is a methodology for building methodologies. The methodology is composed of a set of rules and procedures that, when followed and applied to any problem area, will result in a systematic set of procedures for dealing with that problem area. The following major processes of the methodology…

Describes research and evaluation on the Information Mapping method of structured analysis and writing of training and reference documents to illustrate how a flaw in research design can cause "little or no effect" results. Information retrieval experiments, learning experiments, and field tests are examined for problems, including size…

The last decade has seen the emergence in the policy arena of a new form of qualitative research, one intended to strenghten its ability to generalize while preserving in-depth description. These multisite qualitative studies address the same research question using similar data collection and analysis procedures in a number of settings. To gain…

In reexamining the implementation results from a true experiment in criminal justice, this analysis brackets true treatment effects by partitioning experimental and control groups into treated and untreated subgroups and by combining two independent data sources. A positive association was found between magnitude of experimental treatment…

The authors respond to criticism and analyses by Eva Rezmovic (TM 507 851) of their experimental design, particularly the suggested use of information on the amount of program service received by the control group comparable to the treatment group in their study of the relationship between program implementation levels and program outcomes. (CM)

The National Household Education Survey (NHES) was conducted for the first time in 1991 as a way to collect data on the early childhood education experiences of young children and participation in adult education. Because the NHES methodology is relatively new, field tests were necessary. A large field test of approximately 15,000 households was…

Describes a feasibility study designed to investigate interactive video and the balance of student versus program control with respect to the sequence of content presentation, the choice of how many practice exercises to do, and the strategy for alternating between the modes of receptive and active learning. (MBR)

This document is a summary and evaluation of methodological procedures and results for the field test of the Beginning Postsecondary Student Longitudinal Study Second Followup, 1990-94 (BPS:90/94). The BPS study is a departure from previous studies in that it starts with a cohort of individuals as they enter their postsecondary studies regardless…

This document provides the description, summary, and evaluation of methodological procedures and results for the field test of the 1995-96 National Postsecondary Student Aid Study (NPSAS:96). Chapter 1 describes the background, purposes, and scheduled procedures of the NPSAS:96 and the unique purposes of the field test. The NPSAS is a…

This document presents a summary of the field test results from the first follow-up of the 1992 Beginning Postsecondary Students Longitudinal Study (BPS:90/92). The BPS:90/92 represents a departure from previous longitudinal studies of high school students in that it starts with a cohort of individuals beginning their postsecondary education…

This report supplies details of the design and data analysis of the 1986 National Assessment of Educational Progress (NAEP) to allow the reader to judge the utility of the design, data quality, reasonableness of assumptions, appropriateness of data analyses, and generalizability of inferences made from the data. After an introduction by A. E.…