Purpose: The present study aimed to validate the Indonesian-language version of the psychological capital questionnaire (PCQ), specifically within the context of higher education, by utilising Rasch analysis to evaluate the reliability and validity aspect such as item-fit statistics, rating scale function, and differential item functioning of the…

Feeling successful and accomplished is an important aspect of well-being according to Seligman's (2011) PERMA model, which seems to represent an interesting intersection of objective and subjective as well as individual and social factors that are all relevant to flourishing. This paper describes a pilot study aimed at developing an instrument for…

The accurate assessment of analytical thinking in physics, particularly in magnetism, poses substantial challenges due to the limitations of conventional tools in measuring higher-order cognitive skills. This study aimed to validate an analytical skills test in physics, based on Bloom's Revised Taxonomy, with an emphasis on the dimensions of…

This scoping review examines the integration of artificial intelligence (AI) tools into scientific education practices in school settings. Following the PRISMA statement guidelines, a literature search was conducted in the Web of Science and Scopus databases, identifying 2892 articles published between 2020 and 2024. After applying the eligibility…

The Sexuality Knowledge Assessment Questionnaire (SEKAQ) was designed to assess sexuality-related knowledge among adolescents and future health and education professionals, particularly within the context of school-based health education initiatives. This study developed and validated the SEKAQ, an instrument aimed at evaluating critical aspects…

This study examined the psychometric quality of multiple-choice questions generated by two AI tools, ChatGPT and DeepSeek, within the context of an undergraduate Educational Measurement and Evaluation course. Guided by ten learning outcomes (LOs) aligned with Bloom's Taxonomy, each tool was prompted to generate one five-option multiple-choice item…

In The Netherlands, the 4-Skills Scan is an instrument for physical education teachers to assess gross motor skills of elementary school children. Little is known about its reliability. Therefore, in this study the test-retest and inter-rater reliability was determined. Respectively, 624 and 557 Dutch 6- to 12-year-old children were analyzed for…

This paper studies the performance of the FAT-PET-PEESE (FPP) procedure, a commonly employed approach for addressing publication bias in the economics and business meta-analysis literature. The FPP procedure is generally used for 3 purposes: (1) to test whether a sample of estimates suffers from publication bias, (2) to test whether the estimates…

Many researchers use Cronbach's alpha to demonstrate internal consistency, even though it has been shown numerous times that Cronbach's alpha is not suitable for this. Because the intention of questionnaire and test constructers is to summarize the test by its overall sum score, we advocate summability, which we define as the proportion of total…

Under the generalizability-theory (G-theory) framework, the estimation precision of variance components (VCs) is of significant importance in that they serve as the foundation of estimating reliability. Zhang and Lin advanced the discussion of nonadditivity in data from a theoretical perspective and showed the adverse effects of nonadditivity on…

In this article we draw from ecolingusitics and a civic media literacy framework to consider what happened when three pairs of preservice teachers with different academic backgrounds and climate change beliefs jointly evaluated the reliability of two media sources that make opposing arguments about climate change. An ecolinguistics perspective…

Person reliability parameters (PRPs) model temporary changes in individuals' attribute level perceptions when responding to self-report items (higher levels of PRPs represent less fluctuation). PRPs could be useful in measuring careless responding and traitedness. However, it is unclear how well current procedures for estimating PRPs can recover…

Correlation analysis has been used widely by researchers and analysts when analyzing large-scale assessment data. Limit research provided reliable methods to estimate various correlations and their standard errors with the complex sampling design and multiple plausible values taken into account. This report introduces the methodology used by the…

Objective Structured Teaching Exercises (OSTEs) are used to evaluate feedback skills. OSTEs are simulated teaching scenarios using standardized learners and trained facilitators to deliver immediate feedback to participants. As per researchers' limited knowledge, there is no published assessment tool to assess the feedback skills using OSTE in…

Purpose : The study adapted the Career Decision Making Difficulties Questionnaire for the Arab world. The purpose of the study was to test a popular but scientifically unverified belief that people who were employed could experience less CDD. Design/methodology/approach: Career Decision-Making Difficulties Questionnaire was administered to a…