Rating scale development in the field of language assessment is often considered in dichotomous ways: It is assumed to be guided either by expert intuition or by drawing on performance data. Even though quite a few authors have argued that rating scale development is rarely so easily classifiable, this dyadic view has dominated language testing…

Monte Carlo methods are an accepted methodology in regards to generation critical values for a Maximum test. The same methods are also applicable to the evaluation of the robustness of the new created test. A table of critical values was created, and the robustness of the new maximum test was evaluated for five different distributions. Robustness…

The State NAEP program only reports the mean achievement estimate of a subgroup within a given state if it samples at least 62 students who identify with the subgroup. Since some subgroups of students constitute small proportions of certain states' general student populations, these low-incidence groups of students are seldom sufficiently sampled…

This study aimed to demonstrate how one university worked to overcome some of the measurement problems associated with legacy student rating instruments through the creation and investigation of a new student rating instrument based on the most current scholarship on teaching and learning. Measurement problems with legacy instruments include…

This paper examines the quality evaluations of the Greek Universities highlighting those which offer a full-fledged study program of primary education. There are eight principles-criteria according to which each university is evaluated. For each principle, scores may range from 1 (noncompliance with the principle) to 4 (fully compliance). I…

The world has experienced rapid changes, leading to pressing issues such as environmental degradation, social inequality, and resource depletion. As a transdisciplinary field, evaluation has emerged as a crucial tool in addressing these challenges and promoting systemic change. However, concerns have been raised regarding the field's capacity to…

One of the diagnostic tests which is very valuable and used in education frequently is two-tier test. Two-tier tests are used for different purposes such as determining misconceptions, determining the comprehension level of students and etc.. Due to the wide and effective uses of two-tier tests, there are different studies in which two-tier tests…

Purpose: In relation to the boom in China's SCI-indexed publications, this opinion piece examines this phenomenon and looks at future possible directions for the reform of China's research evaluation processes. Design/Approach/Methods: This opinion piece uses bibliographic data for the past decade (2010-2019) from the Science Citation Index…

The notions of indigenous knowledge and cultural philosophies are becoming ubiquitous in many social inquiries, and evaluation is no exception. Nonetheless, the pursuit to embed relevant indigenous philosophies in contemporary evaluation has yet to succeed. In this article, we discuss indigenous relational philosophies, approaches, and practices…

Programme evaluation has developed tremendously over the past 50 years, with a proliferation of evaluation research, an increase in the institutionalization of evaluation, and growth in the professionalization of evaluation. However, existing research and developments are still largely in North America, Europe, Australia, and New Zealand, with…

Accurately assessing students' self-regulated learning remains a persistent challenge due to the construct's complexity and the limitations of individual measurement methods. This study explores the reliability and meaningfulness of assessing upper-secondary students' SRL in English as a Foreign Language classrooms using a convergent triangulation…

The current range and volume of research evaluation-related literature is extensive and incorporates scholarly and policy/practice-related perspectives. This reflects academic and practical interest over many decades and trails the changing funding and reputational modalities for universities, namely increased selectivity applied to institutional…

Social Network Analysis (SNA) is a statistical method used to analyze the social structure and interactions among individuals within a network. SNA is used extensively in a number of disciplines such as sociology, geography, and communications research. However, the use of SNA by practitioners and researchers in assessment and evaluation is much…

Several international large-scale assessments were conducted at the turn of the new century, and during the past two decades the Programme for International Student Assessment (PISA) completed seven cycles of assessment to facilitate practitioners' policy debates and governance. This study reviews PISA-related articles published in English and…

The rise of evaluation and data in education and education policy is a trend manifesting across a wide variety of policy contexts, holding in its grip national and global policies, with impacts that reach the level of individual children, teachers, and their subjectivities. Earlier research has mainly focused on the phenomenon in neoliberal…