Visual analysis is the primary methodology used to determine treatment effects from graphed single-case design data. Previous studies have demonstrated mixed findings related to interrater agreement between both expert and novice visual analysts, which represents a critical limitation of visual analysis and supports calls for also presenting…

Network meta-analysis (NMA) is an extension of pairwise meta-analysis (PMA) which combines evidence from trials on multiple treatments in connected networks. NMA delivers internally consistent estimates of relative treatment efficacy, needed for rational decision making. Over its first 20 years NMA's use has grown exponentially, with applications…

Ensuring internal validity in quantitative research requires, among other conditions, reliable instrumentation. Unfortunately, however, second language (L2) researchers often fail to report and even more often fail to interpret reliability estimates beyond generic benchmarks for acceptability. As a means to guide interpretations of such estimates,…

Background and context: The variables that researchers measure and how they measure them are central in any area of research, including computing education. Which research questions can be asked and how they are answered depends on measurement. Objective: To summarize the commonly used variables and measurements in computing education and to…

The use of assessments that require rater judgment (i.e., rater-mediated assessments) has become increasingly popular in high-stakes language assessments worldwide. Using a systematic literature review, the purpose of this study is to identify and explore the dominant methods for evaluating rating quality within the context of research on…

This report presents a review of the statistical practices of 30 journals representative of the second language field. A review of 150 articles showed a number of prevalent statistical violations including incomplete reporting of reliability, validity, non-significant results, effect sizes, and assumption checks as well as making inferences from…

This research study aims to evaluate the graduate theses and articles conducted on the concept of instructional leadership over the period between 2002 and 2017 in Turkey by means of methodological and statistical analysis techniques. In the study, which is configured by using the case study design as one of the qualitative research methods, the…

This article synthesized evidence for the validity and reliability of the Strengths and Difficulties Questionnaire in children aged 3-5 years. A systematic review using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement guidelines was carried out. Study quality was rated using the Consensus-based Standards for the…

Differences in how writing systems represent language raise important questions about the extent to which the role of linguistic skills such as phonological awareness (PA) and morphological awareness (MA) in reading is universal. In this meta-analysis, the authors examined the relationship between PA, MA, and reading (accuracy, fluency, and…

Grading refers to the symbols assigned to individual pieces of student work or to composite measures of student performance on report cards. This review of over 100 years of research on grading considers five types of studies: (a) early studies of the reliability of grades, (b) quantitative studies of the composition of K-12 report card grades,…

Problem Statement: The number of studies on the effect of educational leadership on several organizational outputs is increasing. The most popular topic to review within the framework of leadership is job satisfaction. In several studies, a positive correlation was found between leadership and job satisfaction. According to the two-factor theory…

Research on generational differences in immigrant youths' academic achievement has yielded conflicting findings. This meta-analysis reconciles discrepant findings by testing meta-analytic moderators. Fifty-three studies provided 74 comparisons on academic outcomes. First- and second-generation youths did not significantly differ on academic…

Speech perception in dyslexia is characterized by a categorical perception (CP) deficit, demonstrated by weaker discrimination of acoustic differences between phonemic categories in conjunction with better discrimination of acoustic differences within phonemic categories. We performed a meta-analysis of studies that examined the reliability of the…

The primary objective of this article was to critically evaluate the routine use of confirmatory factor analysis (CFA) for representing an individual's performance across a battery of executive function tasks. A conceptual review and statistical reanalysis of N = 10 studies that used CFA methods of EF tasks was undertaken. Despite evidence of…

Direct observation recording procedures produce reductive summary measurements of an underlying stream of behavior. Previous methodological studies of these recording procedures have employed simulation methods for generating random behavior streams, many of which amount to special cases of a statistical model known as the alternating renewal…