Network meta-analysis (NMA) is an extension of pairwise meta-analysis (PMA) which combines evidence from trials on multiple treatments in connected networks. NMA delivers internally consistent estimates of relative treatment efficacy, needed for rational decision making. Over its first 20 years NMA's use has grown exponentially, with applications…

Common method variance refers to the amount of uncontrolled systematic error leading to biased estimates of scale reliability and validity and to spurious covariance shared among variables due to common method and/or common source employed in survey-based researches. As the extended use of self-report questionnaires is inevitable, numerous studies…

This article discusses the nonuse, misuse, and proper use of pilot studies in experimental evaluation research. The authors first show that there is little theoretical, practical, or empirical guidance available to researchers who seek to incorporate pilot studies into experimental evaluation research designs. The authors then discuss how pilot…

This article reviews all (quasi)experimental studies appearing in the first 19 volumes (1997-2015) of "Language Teaching Research" (LTR). Specifically, it provides an overview of how statistical analyses were conducted in these studies and of how the analyses were reported. The overall conclusion is that there has been a tight adherence…

This article contains a second-order meta-analysis and an exploration of bias in the technology integration literature in higher education. Thirteen meta-analyses, dated from 2000 to 2014 were selected to be included based on the questions asked and the presence of adequate statistical information to conduct a quantitative synthesis. The weighted…

Examines the prevalence of inflated Type I error in counseling research and recommends wider use of multivariate statistics to correct the problem. Type I error becomes inflated beyond acceptable levels when researchers perform individual univariate statistics on each of several dependent variables within a single project. (Author)

This report examines the difference in approaches between sociologists and psychologists when using multiple regression techniques in the analysis of behavioral data. Psychologists and sociologists are often divided in their orientation toward regression techniques, and this division could be a substantial and unfortunate barrier to communication…

This study compared 4,594 student responses from three different surveys of incoming students at the University of South Florida (USF) with data from Florida's State University System (SUS) admissions files to determine what proportion of error occurs in the survey responses. Specifically, the study investigated the amount of measurement error in…