This paper describes the development of a bibliometric strength, potential and risk analysis tool, and its applications for research strategy and evaluation. We focus specifically on the motivation, organizational strategic needs, the development and evaluation of the tool. Furthermore, we highlight the co-creation process of the tool and discuss…

Computer-based simulation is utilised across various educational fields, employing diverse technologies to facilitate practical understanding of content and the acquisition of skills that can help close the gap between theory and practice. The possibility of providing scenarios that resemble on-the-job tasks, enables instructors to both train and…

Background: Assessment tools that assess pragmatic skills in adults with a mild-severe traumatic brain injury (TBI) are hard to access, not person-centred and have a high risk of clinician bias. The Pragmatics Profile is an informant report tool that was originally designed to assess pragmatic skills in people with a developmental disability.…

The template-based automated item-generation (TAIG) approach that involves template creation, item generation, item selection, field-testing, and evaluation has more steps than the traditional item development method. Consequentially, there is more margin for error in this process, and any template errors can be cascaded to the generated items.…

In the digital age, handwriting literacy has declined to a worrying degree, especially in non-alphabetic writing systems. In particular, Chinese (and also Japanese) handwriters have suffered from character amnesia ([Chinese characters omitted]), where people cannot correctly produce a character though they can recognize it. Though character…

Background: Given the significant gap in tailored assessment tools, this research seeks to adapt the Self-concept (Form 5-AF5) questionnaire for young students with intellectual disabilities, employing an inclusive approach. Method: Twenty-three disability experts initially assessed questionnaire suitability, leading to revisions for clarity.…

Multiple-choice items are universally used in formal education. Since they should assess learning, not test-wiseness or guesswork, they must be constructed following the highest possible standards. Hundreds of item-writing guides have provided guidelines to help test developers adopt appropriate strategies to define the distribution and sequence…

Leading a school during the uncertainties of challenges, changes, and crises requires school principals to respond and react effectively, cohesively and proactively using resilience. Rather than using discrete contracts or dimensions to measure principal resilience, this paper tended to develop and validate a multidimensional instrument of…

This study describes the development of the science, technology, engineering, and mathematics (STEM) Scale, intended to assess parental attitudes toward school programs designed to deliver STEM, and evaluates its psychometric properties. The study group included 400 parents of students (138 males and 262 females) enrolled in STEM programs…

When designing or modifying a test, an important challenge is controlling its speededness. To achieve this, van der Linden (2011a, 2011b) proposed using a lognormal response time model, more specifically the two-parameter lognormal model, and automated test assembly (ATA) via mixed integer linear programming. However, this approach has a severe…

A recurring question regarding Likert items is whether the discrete steps that this response format allows represent constant increments along the underlying continuum. This question appears unsolvable because Likert responses carry no direct information to this effect. Yet, any item administered in Likert format can identically be administered…

The purpose of this study was originally to create an operational definition of the "appearance of competence" to design valid questions for educational professionals supporting twice-exceptional (2e) learners to create a testing instrument. Through the methodological process of grounded theory, a replacement research question emerged as…

Question generation (QG) task plays a crucial role in adaptive learning. While significant QG performance advancements are reported, the existing QG studies are still far from practical usage. One point that needs strengthening is to consider the generation of question group, which remains untouched. For forming a question group, intrafactors…

Multidimensional achievement tests are recently gaining more importance in educational and psychological measurements. For example, multidimensional diagnostic tests can help students to determine which particular domain of knowledge they need to improve for better performance. To estimate the characteristics of candidate items (calibration) for…

Short scales are time-efficient for participants and cost-effective in research. However, researchers often mistakenly expect short scales to have the same reliability as long ones without considering the effect of scale length. We argue that applying a universal benchmark for alpha is problematic as the impact of low-quality items is greater on…