The effects of different response option orders on survey responses have been studied extensively. The typical research design involves examining the differences in response characteristics between conditions with the same item stems and response option orders that differ in valence--either incrementally arranged (e.g., strongly disagree to…

Differential item functioning (DIF) is often used to examine validity evidence of alternate form test accommodations. Unfortunately, traditional approaches for evaluating DIF are prone to selection bias. This article proposes a novel DIF framework that capitalizes on regression discontinuity design analysis to control for selection bias. A…

This paper presents evidence confirming the validity of the RD design in the Reading Recovery study by examining the ability of the RD design to replicate the 1st grade results observed in the original i3 RCT focused on short-term impacts. Over 1,800 schools participated in the RD study over all four cohort years. The RD design used cutoff-based…

This report presents a review of the statistical practices of 30 journals representative of the second language field. A review of 150 articles showed a number of prevalent statistical violations including incomplete reporting of reliability, validity, non-significant results, effect sizes, and assumption checks as well as making inferences from…

Elicited imitation (EI) has been widely used to examine second language (L2) proficiency and development and was an especially popular method in the 1970s and early 1980s. However, as the field embraced more communicative approaches to both instruction and assessment, the use of EI diminished, and the construct-related validity of EI scores as a…

To better understand the impact of using e-books on students' reading outcomes, we conducted a meta-analysis of 14 studies with students in grades K-12 published between 2007 and 2018. Findings revealed an average effect size across all studies and reading outcomes of 0.9 that did not differ significantly from zero. There was also no statistically…

To better understand the impact of using e-books on students' reading outcomes, we conducted a meta-analysis of 14 studies with students in grades K-12 published between 2007 and 2018. Findings revealed an average effect size across all studies and reading outcomes of 0.9 that did not differ significantly from zero. There was also no statistically…

Tests of measurement invariance were conducted across culture and gender on the Revised Children's Manifest Anxiety Scale-Second Edition (RCMAS-2) Short Form in a sample of 1,003 Singapore and U.S. adolescents. The results of multi-group confirmatory factor analyses across culture and gender supported at least partial measurement invariance. ANOVA…

The main purpose of this study is to determine the effect of multiple intelligences theory (MIT)-based education on students' academic achievement. In this research, the meta-analytic method was adopted to determine this effect, and studies related to this subject carried out in Turkey were compiled. The effect sizes of the studies included in the…

While studies have been done to rate the validity and reliability of the Oral Proficiency Interview (OPI) and Oral Proficiency Interview-Computer (OPIc) independently, a limited amount of research has analyzed the interexam reliability of these tests, and studies have yet to be conducted comparing the results of Spanish language learners who take…

We describe our experience of using a modified version of the Cochrane risk of bias (RoB) tool for randomised and non-randomised comparative studies. Objectives: (1) To assess time to complete RoB assessment; (2) To assess inter-rater agreement; and (3) To explore the association between RoB and treatment effect size. Methods: Cochrane risk of…

Many meta-analyses of comparative outcome studies found a substantial association of researcher allegiance (RA) and relative treatment effects. Therefore, RA is regarded as a biasing factor in comparative outcome research (RA bias hypothesis). However, the RA bias hypothesis has been criticized as causality might be reversed. That is, RA might be…

The domain of environmental protection is comprised from many sub-domains as recycling, conserving water, or reducing the consumption of energy. The attitude-behavior gap is partly explained by the gap between the specificity levels of the particular measured behavior and of its antecedent(s). The present study aimed at assessing the effects of…

The present study examines treatment length and timing of exposure from two child anxiety disorders clinics. Data regarding symptoms and treatment characteristics for 28 youth were prospectively obtained through self, parent, and therapist report at each session. Information regarding length of treatment, timing of exposure initiation, and…

Critical to meta-analysis is the presumption that effect sizes based on different measures are directly comparable. Recent theoretical work has shown that an invariance condition--universe score, or construct, validity invariance--must hold for either observed score or reliability-corrected effect sizes based on different measures to be directly…