With the opportunities and challenges stemming from the artificial intelligence developments and its integration into society, AI literacy becomes a key concern. Utilizing quality AI literacy instruments is crucial for understanding and promoting AI literacy development. This systematic review assessed the quality of AI literacy scales using the…

Background: A systematic review is a secondary research method that follows a predetermined protocol to identify, synthesize, and assess the quality of primary studies that meet pre-established eligibility criteria to answer a specific research question (Higgins & Green, 2011; Higgins & Thomas, 2019). It uses systematic and transparent…

Evaluation capacity building (ECB) continues to attract the attention and interest of scholars and practitioners. Over the years, models, frameworks, strategies, and practices related to ECB have been developed and implemented. Although ECB is highly contextual, the evolution of knowledge in this area depends on learning from past efforts in a…

In many sectors and in many respects, interdisciplinarity has made progress in recent decades, but less so when it comes to evaluating interdisciplinary work. Challenges remain, especially regarding what counts as 'good' interdisciplinarity. While previous reviews describe broad trends contributing to these challenges, high-level observations are…

The US continues to transition toward a majority-minority composition and this trend has advanced most rapidly for school-aged children. Clinical work with diverse populations, and their families, calls for specialized skills and training experiences; however, these are not yet strongly reflected in most pre-service training programs in applied…

The use of assessments that require rater judgment (i.e., rater-mediated assessments) has become increasingly popular in high-stakes language assessments worldwide. Using a systematic literature review, the purpose of this study is to identify and explore the dominant methods for evaluating rating quality within the context of research on…

The researchers of various disciplines often use qualitative and quantitative research methods and approaches for their studies. Some of these researchers like to be known as qualitative researchers; others like to be regarded as quantitative researchers. The researchers, thus, are sharply polarised; and they involve in a competition of pointing…

This article introduces practitioners and researchers to the topic of missing data in the context of differential item functioning (DIF), reviews the current literature on the issue, discusses implications of the review, and offers suggestions for future research. A total of nine studies were reviewed. All of these studies determined what effect…

University rankings have raised huge interest in the social sciences because of their methodological foundations and impact. Rankings have also gained popularity in the media system. In this article we analyze the coverage offered by the media to the Italian Research Evaluation exercise--VQR 2004-2010. Even though this evaluation did not have…

Although investigations into evaluation theories, methods, and practices have been occurring since the late 1970s, research on evaluation (RoE) has seemingly increased in the past decade. In this review, 257 studies published in 14 evaluation-focused journals over a 10-year period (between 2005 and 2014) were identified as RoE and then classified…

The goal of this study was to analyse international journals and conference proceedings published from 2012 to 2016. The main results indicated that the gap between the Arab Gulf Countries (GC) and the rest of the world regarding the amounts and trends of professional development (PD) research is too wide. At the global level, the initial scanning…

As dynamic assessment (DA) continues to come to prominence as a procedure that endeavors to ameliorate learner performance and further development through mediators' assistance with the intent of discerning learning potential, a plethora of research has delved into the applicability of DA in second/foreign language education. This article employed…

As methods for automated scoring of constructed-response items become more widely adopted in state assessments, and are used in more consequential operational configurations, it is critical that their susceptibility to gaming behavior be investigated and managed. This article provides a review of research relevant to how construct-irrelevant…

With the push for evidence-informed policy and practice, schools and policy makers are now increasingly encouraged and supported to use and enagage with research evidence. This means that consumers of research will now need to be discerning in judging the quality of research evidence that will inform their decisions. This paper evaluates the…

This article discusses the nonuse, misuse, and proper use of pilot studies in experimental evaluation research. The authors first show that there is little theoretical, practical, or empirical guidance available to researchers who seek to incorporate pilot studies into experimental evaluation research designs. The authors then discuss how pilot…