The "LFK" index has been promoted as an improved method to detect bias in meta-analysis. Putatively, its performance does not depend on the number of studies in the meta-analysis. We conducted a simulation study, comparing the "LFK" index test to three standard tests for funnel plot asymmetry in settings with smaller or larger…

Background: Objective Structured Clinical Examinations (OSCEs) are a simulation-based assessment tool used extensively in medical education for evaluating clinical competence. OSCEs are widely regarded as more valid, reliable, and valuable compared to traditional assessment measures, and are now emerging within professional psychology training…

The primary aim of the study is to develop an augmented reality (AR) acceptance scale within the framework of the unified theory of acceptance and use of technology (UTAUT) model to measure individuals' acceptance and use of AR technology. The study was performed with a total of 546 university students with three participant groups in the…

As diagnostic classification models become more widely used in large-scale operational assessments, we must give consideration to the methods for estimating and reporting reliability. Researchers must explore alternatives to traditional reliability methods that are consistent with the design, scoring, and reporting levels of diagnostic assessment…

This article presents some equivalent forms of the common Kuder-Richardson Formula 21 and 20 estimators for nondichotomous data belonging to certain other exponential families, such as Poisson count data, exponential data, or geometric counts of trials until failure. Using the generalized framework of Foster (2020), an equation for the reliability…

The aim was to determine the validity and test-retest reliability of the Sit to Stand App variables (rising time, vertical velocity, and power) for measuring single-leg sit-to-stand (STS) test compared to those derived from ground reaction force data. Twenty-seven female athletes performed the single-leg STS test over three consecutive sessions…

Immersive virtual reality (IVR) takes advantage of exponential growth in our technological abilities to offer an array of new forms of entertainment, learning opportunities, and even psychological interventions and assessments. The field of creativity is a driving force in both large-scale innovations and everyday progress, and imbedding…

Purpose: The present study examined the psychometric properties of the EGame-flow scale in a Mexican sample, presenting evidence of construct validity (exploratory factor analysis and confirmatory factor analysis), reliability (Cronbach's alpha and McDonald's omega) and discriminant validity (mean variance extracted). Design/methodology/approach:…

Careful considerations are necessary when there is a need to choose an anchor test form from a list of old test forms for equating under the random groups design. The choice of the anchor form potentially affects the accuracy of equated scores on new test forms. Few guidelines, however, can be found in the literature on choosing the anchor form.…

Complex competences, such as managing students' aggressive behaviour, are challenging to develop during teacher training. Recently, video-based simulations have been considered promising, yet suitable assessment instruments are limitedly available. This paper reports on the design and evaluation of a video-based assessment tool tailored to measure…

This study aims to investigate the factors influencing teachers' intentions to integrate Virtual Reality (VR) technology into their educational practices, utilising the Unified Theory of Acceptance and Use of Technology (UTAUT-2) framework. The research involved adapting and validating the 'Acceptance of Mobile Immersive Virtual Reality in…

We compared coefficient alpha with five alternatives (omega total, omega RT, omega h, GLB, and coefficient H) in two simulation studies. Results showed for unidimensional scales, (a) all indices except omega h performed similarly well for most conditions; (b) alpha is still good; (c) GLB and coefficient H overestimated reliability with small…

Clinical, medical, and health psychologists use difference scores obtained from pretest--posttest designs employing the same test to assess intraindividual change possibly caused by an intervention addressing, for example, anxiety, depression, eating disorder, or addiction. Reliability of difference scores is important for interpreting observed…

Emerging technologies can potentially transform education through student engagement. The aim of our study is threefold. Firstly, we aspired to examine the validity and reliability of Reeve and Tsengs' 4-construct (emotional, behavioral, cognitive, and agentic) engagement scale (EBCA scale). Secondly, we aimed to examine whether and to what extent…

This study is an attempt to develop a reliable and valid measurement tool to measure secondary school students' attitudes towards metaverse use. Therefore, the study reported the analyses related to metaverse attitude scale (MVAS). The content validity of the scale was ensured by an expert's view, and Exploratory Factor Analysis (EFA) and…