We revisit the merits of the retrospective pretest-posttest (RPP) design for repeated-measures research. The underutilized RPP method asks respondents to rate survey items twice during the same posttest measurement occasion from two specific frames of reference: "now" and "then." Individuals first report their current attitudes…

There is a need for a holistic usability evaluation framework that accommodates social constructivist online courses. Social knowledge construction may not be adequately evaluated using current frameworks. This qualitative research study examined the usability needs of a social constructivist online course. Data from an online course were analyzed…

This study analyzed data from four evaluation designs incorporating the retrospective pretest (i.e., thentest), analyzing the effects of self-report pretesting and post-program survey format on a set of self-report measures. Validity of self-report data was assessed by comparing the criterion validity of then ratings to established benchmarks and…

The iPod digital music player has been available since late 2001, and even in higher education, its presence has been seen, although mostly in the hands of students and rarely for outcomes-based educational purposes. In 2004, Duke University provided free iPods to all 1,650 first year students, which subsequently enabled faculty to create learning…

Evaluated effects of pretesting in conjunction with a group social skills training program. A Solomon four-groups design was used to evaluate the effects of pretesting, the skills training program, and their interaction. Strong evidence of pretesting effects was found for measures associated with a behavioral forced interaction task. (Author)

As the final volume in a 4-volume evaluation report on the University of Massachusetts Non-Formal Education Project (UMass NFEP) initiated in rural Ecuador in 1973, this volume presents appendices to volumes I-III. Appendix A includes the following items: (1) Community Demographic Profile; (2) Description of Introduction to the Community; (3)…

An evaluation of a school-based drug education program was employed to examine the effect of administration of a preteaching questionnaire on responses. Found pretesting increased the amounts of alcohol reported consumed and reports of drunkenness and marijuana use. (Author)

The impact of achievement testing on a Spring-Spring vs. a Fall-Spring basis in evaluation of compensatory education programs is examined. The effects of the summer vacation period and crossing test levels were examined. Significant decreases in achievement test scores were found, at all grade levels, between Spring and Fall test administrations.…

One of five sections of materials for a program to change teacher attitudes toward career education, the document presents the results of the pilot testing of the program. The attitude change product was evaluated by a pilot test plan and a field test plan. Design, data collection, and data interpretation for each test plan are described. Although…

The accuracy with which regression models estimate treatment effects is dependent upon a number of conditions. The stability of the regression line (a function of sample size and correlation between pretest and posttest) is said to be the most important of these conditions. The utility of regression models is proportional to the size of the…

The Buffalo career education project is presented in two parts, the final report and the summary evaluation. The components of the program described and analyzed in the report are: (1) infusion of career concepts into the existing curriculum; (2) vocational skill training for entry jobs; (3) business, labor, and industry contribution to career…

This study evaluated a childrens' school program which was part of a residential facility for children, aged 6-13, defined as being emotionally disturbed. The length of stay (LOS) at the facility was a major concern. The LOS was studied to see if it was related to changes in I.Q. and achievement scores from admission to discharge. Another…

Recent research results strongly suggest that the theoretical problems of change measures have limited practical significance for measuring individual growth, and it is important to determine whether this is also the case for measuring school impact. Accordingly, in this study artifical data were used to assess the correlation between several…

The ALL WIN-U.S.A. Project, administered by the Office of the Los Angeles County Superintendent of Schools (OLACSS), was to provide basic-skills instruction in reading and mathematics that would result in significant improvement in the respective achievement domains, in learner attitudes, and cost effectiveness relative to the previous curriculum…

Action research often necessitates the use of intact groups for the comparison of educational treatments or programs. This paper considers several analytical methods that might be used for such situations when pretest scores indicate that these intact groups differ significantly initially. The methods considered include gain score analysis of…