Until now, the conventional approach using two distinct groups, experimental and control, continues to dominate research, especially education research. Researchers, particularly those who are active in this domain, readily recognise this pattern when surveying literature. This article explores the use of the Solomon four-group design as a…

The current study examined whether the learning benefits of pretesting--like those produced by posttesting--generalize to classroom settings, and whether such benefits transfer to non-pretested related information. Before some lectures but not others, undergraduate students enrolled in a large research methods class were given a brief competitive…

We explore the conditions under which short, comparative interrupted time-series (CITS) designs represent valid alternatives to randomized experiments in educational evaluations. To do so, we conduct three within-study comparisons, each of which uses a unique data set to test the validity of the CITS design by comparing its causal estimates to…

This article summarizes results from 12 empirical evaluations of observational methods in education contexts. We look at the performance of three common covariate-types in observational studies where the outcome is a standardized reading or math test. They are: pretest measures, local geographic matching, and rich covariate sets with a strong…

The aim of this case study is to highlight the importance of piloting or pre-testing the research design (in this case, semi-structured interviews and narratives). Most textbooks offer minimal guidance about pre-testing the research design, and published reports rarely report whether the research was piloted and, if so, what were the results.…

In this study, we investigated whether incorporating eye tracking into cognitive interviewing is effective when pretesting survey questions. In the control condition, a cognitive interview was conducted using a standardized interview protocol that included pre-defined probing questions for about one-quarter of the questions in a 52-item…

There is a need for a holistic usability evaluation framework that accommodates social constructivist online courses. Social knowledge construction may not be adequately evaluated using current frameworks. This qualitative research study examined the usability needs of a social constructivist online course. Data from an online course were analyzed…

Problems in insuring informed consent may be of greater significance for elderly adults with low levels of vocabulary and education. To protect the rights of these elderly individuals it may be necessary to use tests for comprehension before participation in research investigations. (Author)

Studies 20 teachers (16 women, four men) in pre-, post-, and follow-up testing of Teacher Effectiveness Training (TET) for active listening skills and I-message skills. (Editor/RK)

This booklet presents techniques used by the Office of Cancer Communications of the National Cancer Institute for pretesting health education materials for professional, patient, and public audiences. The approaches and experiences of other health organizations are also reviewed. Described are principles of pretesting and how pretesting can be…

Eight, ten, and twelve year old children were tested on a novel procedure involving the successive presentation of standard and comparision stimuli. Two hypotheses were evaluated: one dealing with memory effects, and the other with children's pretesting of choice responses in spatial information processing. (Editor/RK)

The development of a project to assess the effectiveness of schools in a large urban school district is described in this paper, with a focus on improving the validity of school effectiveness instruments. Purposes of the project were to develop a methodology for reporting effective school strategies and to generate a broader profile of schools'…

After offering some possible explanations for the existing inadequacies in evaluating organizational training programs, the authors discuss several evaluation issues, particularly internal validity. Methods for overcoming evaluation inadequacies and the implications for better controlled evaluation designs are also covered. (EM)

Information on why readership surveys are valuable and on how to conduct them is presented, along with sample surveys used at a number of different institutions, and a questionnaire used by the Council for Advancement and Support of Education to measure the opinion of "CASE CURRENTS," readers. Guidelines for doing a mail survey outline…

This supporting statement accompanied the first followup questionnaire for the National Longitudinal Study of the High School Class of 1972, when it was submitted for government clearance. The first part of the statement gives the background, uses, and justification of the survey; the largest part describes the plans for the first follow-up…