Factor analysis is widely utilized to identify latent factors underlying the observed variables. This paper presents a comprehensive comparative study of two widely used methods for determining the optimal number of factors in factor analysis, the K1 rule, and parallel analysis, along with a more recently developed method, the bass-ackward method.…

The use of Mixed Methods (MM) in evaluation has increasingly become a valuable asset in evaluators' methodological toolbox. Despite prolific research on various aspects of mixed methods, from typologies to ontological debates, there remains a dearth of empirically derived evidence on effectively communicating MM findings. This lack of empirical…

A necessary step in applying bi-factor models is to evaluate the need for domain factors with a general factor in place. The conventional null hypothesis testing (NHT) was commonly used for such a purpose. However, the conventional NHT meets challenges when the domain loadings are weak or the sample size is insufficient. This article proposes…

As an alternative to conventional instruction and evaluation methods, dynamic assessment aims to promote language learning by utilising an interactive approach. As a subset of dynamic assessment, the interventionist approach to dynamic assessment focuses on mediation from implicit to explicit. In spite of its central role in language learning and…

The purpose of this study was to evaluate the degree of classification quality in the basic latent class model when covariates are either included or are not included in the model. To accomplish this task, Monte Carlo simulations were conducted in which the results of models with and without a covariate were compared. Based on these simulations,…

Assessing cases of child welfare requires the ability to engage with different sources of information systematically. This study examined how case-based learning (CBL) can be used to support social work students (N = 104) acquire knowledge crucial to assessing cases of child welfare and whether benefits of CBL could be maximized by structuring the…

Calligraphy is the treasure of traditional Chinese culture and it is ubiquitous in China. Because of the unique aesthetic characteristics of calligraphy, the difficulty of calligraphy teaching lies in the assessment of calligraphy works. The major problems concerning calligraphy assessment are the low time efficiency of calligraphy assessment and…

The application of network meta-analysis is becoming increasingly widespread, and for a successful implementation, it requires that the direct comparison result and the indirect comparison result should be consistent. Because of this, a proper detection of inconsistency is often a key issue in network meta-analysis as whether the results can be…

This study explores the use of Large Language Models (LLMs), specifically GPT-4, in analysing classroom dialogue--a key task for teaching diagnosis and quality improvement. Traditional qualitative methods are both knowledge- and labour-intensive. This research investigates the potential of LLMs to streamline and enhance this process. Using…

The purpose of this study is to identify the difference between elementary pupils' higher order thinking skill (HOTS) in an environment learning using a variety of resources in a local culture-based learning. HOTS differences between those who use printed and electronic learning resources after controlling self-regulated learning pupil. This is an…

Peer assessment has an important role in teaching and learning nowadays. However, the existing techniques tend to be limited due to a lack of a suitable means to evaluate the accuracy of peer assessment activities and supervise peer assessment performances in an online environment. Hence, it is very necessary to develop new solutions encourage…

Measures of learning speed (i.e., the amount of learning/cumulative time learner spends engaged in an intervention) are rarely included in research designed to evaluate and compare academic interventions. We build a case that includes analyses of learning speed metrics in academic intervention research can provide more useful information for…

This study conducted a comprehensive comparison of Item Response Theory (IRT) linking methods applied to a bifactor model, examining their performance on both multiple choice (MC) and mixed format tests within the common item nonequivalent group design framework. Four distinct multidimensional IRT linking approaches were explored, consisting of…

The synthetic control method (SCM) is a popular approach for estimating the impact of a treatment on a single unit with panel data. Two challenges arise with higher frequency data (e.g., monthly versus yearly): (1) achieving excellent pre-treatment fit is typically more challenging; and (2) overfitting to noise is more likely. Aggregating data…

Developing models and using mathematics are two key practices in internationally recognized science education standards such as the Next Generation Science Standards (NGSS, 2013). In this paper, we used a virtual performance-based formative assessment to capture students' competencies at both "developing" and "evaluating"…