This meta-analysis examined the validity of an alternative to traditional assessments called the Wonderlic which is a brief measure of general mental ability. Our results showed significant, positive correlations between Wonderlic scores and academic performance in general ([r-bar] = 0.26), between Wonderlic scores and undergraduate GPA in…

To determine the effects of explicit instruction (EI) and potential moderators in second/foreign language (L2) teaching, this study meta-analyzed 28 primary reports (a total of 67 unique samples, N = 3754). The main results show that EI was significantly effective in facilitating L2 development, with effect sizes ranging from moderate to large…

Dynamic assessments (DAs) of word reading skills demonstrate strong criterion reference validity with word reading measures (WRMs). However, DAs vary in the skills they assess, their format and administration method, and the type of words and symbols used in test items. These characteristics may have implications on assessment validity. To compare…

The aim of this study is to examine the available scientific evidence on the reliability and criterion validity of 6-minute run walk field-based test when administered to children and adolescents. Systematic searches were performed in three electronic databases (MEDLINE/PubMed, SPORTDiscuss and Scopus) from their inception until February 2024,…

Meta-analysis of diagnostic test accuracy (DTA) is a powerful statistical method for synthesizing and evaluating the diagnostic capacity of medical tests and has been extensively used by clinical physicians and healthcare decision-makers. However, publication bias (PB) threatens the validity of meta-analysis of DTA. Some statistical methods have…

This systematic review investigated the topics studied and reporting practices of published meta-analyses in educational measurement. Our findings indicated that meta-analysis is not a highly utilized methodological tool in educational measurement; on average, less than one meta-analysis has been published per year over the past 30 years (28…

Content-based techniques for credibility assessment (Criteria-Based Content Analysis [CBCA], Reality Monitoring [RM]) have been shown to distinguish between experience-based and fabricated statements in previous meta-analyses. New simulations raised the question whether these results are reliable revealing that using meta-analytic methods on…

The purpose of this systematic review was to survey available measures of creativity for pk12 students for assessments characteristics and reporting of psychometric properties. Using the PRISMA framework, we identified 42 unique articles with 48 assessments meeting our inclusion criteria. Then, two coders independently coded all articles using a…

A best-evidence synthesis and meta-analysis were conducted to evaluate interventions designed to decrease noncompliance in early childhood settings. Studies were examined for quality, intervention components, and outcomes for young children (ages 2-8 years) across settings. Results indicated most designs were high-quality and produced desired…

The meta-analytic-predictive (MAP) approach is a Bayesian method to incorporate historical controls in new trials that aims to increase the statistical power and reduce the required sample size. Here we investigate how to calculate the sample size of the new trial when historical data is available, and the MAP approach is used in the analysis. In…

Meta-analytical methods face particular challenges in research fields such as social and political research, where studies often rest primarily on qualitative and case study research. In such contexts, where research findings are less standardized and amenable to structured synthesis, the case survey method has been proposed as a means of data…

Thousands of education institutions worldwide rely on IELTS scores as criteria for accepting international students whose first language is not English. Individual studies have found varying degrees of strength of correlations and conflicting results between IELTS entry scores and subsequent academic success. These conflicting results were…

This meta-analysis examined the ecological and population validity of intervention research for students with low mathematics achievement (SWLMA). Forty-four studies published between 2005 and 2019 that met the inclusionary criterion were included in this analysis. Our findings suggest, to improve the external validity and generalizability of…

This quantitative synthesis combines results of 72 studies that published psychometric information for the Multicultural Counseling Inventory. Although internal consistency, subsample means, and intrascale correlations provide promising evidence, convergent correlations with other instrumentation and factor analyses of validity continue to raise…

Many test developers try to ensure the content validity of their tests by having external experts review the items, e.g. in terms of relevance, difficulty, or clarity. Although this approach is widely accepted, a closer look reveals several pitfalls need to be avoided if experts' advice is to be truly helpful. The purpose of this paper is to…