Although evaluators often use an interrupted time series (ITS) design to test hypotheses about program effects, there are few empirical tests of the design's validity. We take a randomized experiment on an educational topic and compare its effects to those from a comparative ITS (CITS) design that uses the same treatment group as the experiment…

This study aimed to develop a suggested model related to the student's portfolio used in evaluating the students in the university courses. After revising the theoretical literature and previous studies, two tools of the study have been constructed: Suggested model related to the student portfolio, and identifying the specifications towards using…

Minimal evidence exists regarding the retrospective pretest's effectiveness as a tool to obtain usable, indirect evidence of student learning in open admissions institutions. The researcher conducted this study to determine if a retrospective pretest more accurately detected a change in students' knowledge compared to a conventional…

This article provides two illustrations of some of the factors that can influence findings from pre- and post-test research designs in evaluation studies, including regression to the mean (RTM), maturation, history and test effects. The first illustration involves a re-analysis of data from a study by Marsden (2004), in which pre-test scores are…

This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…

This study examined whether teacher portfolios can be validly and reliably assessed by investigating the effect of an instructional tool on increasing the level of reflective thinking in elementary preservice teachers' portfolios. It also examined whether reflective thinking in preservice teachers' electronic portfolios represented sufficient…

We use unique administrative data from a leading Italian university to estimate whether the use of admission tests and conditional progression schemes are effective strategies to select high-performing students. Previous work, which has been predominantly correlational, has focused on the effect of selectivity policies on widening university…

Differential Item Functioning (DIF) is a group-related item/test characteristic targeting the issue of item/test bias. In this dissertation, a new DIF index is described that has three parts: (1) a DIF measure indicating the degree of different (item) performances between the reference and focal groups, (2) a DIF direction statement about the DIF…

The present study was carried out to find out whether regular administration of cloze test improved the students' knowledge of grammar more than the multiple choice one. Subjects participating in this study were 84 Iranian pre-university students of Allameh-Gotb-e Ravandi University, aged between 18 and 35 and enrolled in a grammar course. To…

Meta assessment goes beyond assessment in that it examines not only the elements of assessment but also the necessary and sufficient conditions as well as the needs of the assessment. Meta assessment in education tends to be the domain of course designers, planners and policy makers but rarely that of students. This article examines the role of…

The third-year evaluation of the federally funded Washington, D.C. voucher program shows that low-income students offered vouchers in the first two years of the program had modestly higher reading scores after three years but showed no significant difference in mathematics. Students were randomly assigned to treatment and control groups, and the…

This article considers various kinds of probability and non-probability samples in both experimental and survey studies. Throughout, how a sample is chosen is stressed. Size alone is not the determining consideration in sample selection. Good samples do not occur by accident; they are the result of a careful design. (Author/JAZ)

In order to make policy decisions, educators must evaluate educational research proposals and projects. Findings immediately related to practice are often inadequate, omitting the theoretical establishment of principles by which we can explain and predict the phenomena of our world. These theoretical linkages to the practical world of…