In educational contexts, students often self-select into specific interventions (e.g., courses, majors, extracurricular programming). When students self-select into an intervention, systematic group differences may impact the validity of inferences made regarding the effect of the intervention. Propensity score methods are commonly used to reduce…

The present article considers a fundamental question in evaluation research: "By how much do program effects vary across sites?" The article first presents a theoretical model of cross-site impact variation and a related estimation model with a random treatment coefficient and fixed site-specific intercepts. This approach eliminates…

This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…

This study aimed to develop a suggested model related to the student's portfolio used in evaluating the students in the university courses. After revising the theoretical literature and previous studies, two tools of the study have been constructed: Suggested model related to the student portfolio, and identifying the specifications towards using…

The goal of this research is to make sensitivity analysis accessible not only to empirical researchers but also to the various stakeholders for whom educational evaluations are conducted. To do this it derives anchors for the omitted variable (OV)-program participation association intrinsically, using the Love plot to present a wide range of…

Background/Context: From two decades of research on the grading practices of teachers in secondary schools, researchers discovered that teachers evaluated students on numerous factors that do not validly assess a student's achievement level in a specific content area. These consistent findings suggested that traditional grading practices evolved…

This research explored how different models of Web-based dynamic assessment in remedial teaching improved junior high school student learning achievement and their misconceptions about the topic of "Weather and Climate." This research adopted a quasi-experimental design. A total of 58 7th graders participated in this research.…

Using exogenous characteristics to identify endogenous subgroups, the approach discussed in this method note creates symmetric subsets within treatment and control groups, allowing the analysis to take advantage of an experimental design. In order to maintain treatment--control symmetry, however, prior work has posited that it is necessary to use…

Personalized e-learning implementation is recognized as one of the most interesting research areas in the distance web-based education. Since the learning style of each learner is different one must fit e-learning with the different needs of learners. This paper presents an approach to integrate learning styles into adaptive e-learning hypermedia.…

Introduction: The use of self efficacy has been suggested as an effective classroom intervention procedure. The present research examined the use of self-efficacy training on the writing of Spanish elementary student with learning disabilities. Objectives: We present a research study focused on the improvement of the writing product and the…

In 1989 the North Central Higher Learning Commission joined a growing movement to improve learning and classroom assessment. The movement called for a more inclusive type of assessment that involves tasks other that learning for testing. The Association of American Colleges and Universities agreed and proposed new Principles of Excellence…

Selectivity bias arises in program evaluation when the treatment or control status of the subjects is related to unmeasured characteristics that themselves are related to the program outcome under study. This situation has the potential to lead to an incorrect estimation of the treatment effect when assignment to treatment and control groups is…

In 2006, the Bill & Melinda Gates Foundation launched the Early Learning Initiative (ELI) to improve the school readiness of Washington State's children through three main strategies: (1) development of high-quality, community-wide early learning initiatives in two communities; (2) enhancement of statewide systems that support early…

A method is presented for analyzing data collected in a multiple group time-series design. This consists of testing linear hypotheses about the experimental and control group-means. Both a multivariate and a univariate procedure are described. (Author/GK)

Matching, randomization, random sampling, and other methods of controlling extraneous variation are discussed. The purpose was to specify the benefits of randomization in estimating causal effects of treatments. It is concluded that randomization should be employed whenever possible, but the use of carefully controlled nonrandomized data to…