Many methods are used to measure interrater reliability for studies where each target receives ratings by a different set of judges. The purpose of this study is to explore the use of hierarchical modeling for estimating interrater reliability using the intraclass correlation coefficient. This study provides a description of how the ICC can be…

This paper investigates the methodological discrepancies underlying the measurement of adult learning and education (ALE) participation in the UK by focusing on four major surveys -- APiL, PIAAC, AES, and LFS. Grounded in the Total Survey Error (TSE) framework, we systematically examined the surveys' documentation and compared their definitions,…

Although it is commonly believed that automation aids human decision-making, conflicting evidence raises questions about whether individuals would gain greater advantages from automation in difficult tasks. Our study examines the combined influence of task difficulty and automation reliability on aided decision-making. We assessed decision…

The Attitudes to Inclusion Scale (AIS) and the Intention to Teach in Inclusive Classroom Scale (ITICS) are instruments widely used internationally for researching teachers' attitudes and intentions towards inclusive education (IE). This study presents information on psychometric analysis of the AIS and ITICS as well as their functioning in the…

The scope of the school nursing practice tool (SSNPT) is needed to apply and explore the gap between what school nurses perceive as important and actual practices. This study adapted and validated the Korean version of SSNPT (K-SSNPT) among 360 Korean school nurses in January 2022. The reliable and valid K-SSNPT can inform school nurses' workforce…

Career aspirations of high school students is a significant motivational force for learning engagement. However, validated methods for probing their career aspirations remain unestablished. Study 1 used 1455 high school students to develop a career aspirations questionnaire (CAQ). The CAQ was developed through item generation, pretesting,…

A successful teaching-learning process depends heavily on teaching. Wherein the teaching process greatly benefits from the involvement of prospective teachers. They need to approach the teaching with a positive attitude for the teaching-learning process to be effective. Therefore, a reliable instrument is required for assessing the prospective…

The reliability of assessment tools is critical for accurately monitoring student performance in various educational contexts. When multiple assessments are combined to form an overall evaluation, each assessment serves as a data point contributing to the student's performance within a broader educational framework. Determining composite…

Teacher workload leading to burnout is a significant problem facing many teachers today. The "Visual Impairment Scale of Staffing Pattern Analysis (VISSPA)" was designed to address the workload of vision professionals, teachers of students with visual impairments, and orientation and mobility specialists who work itinerantly with…

The rapid shift to online learning during the COVID-19 pandemic highlighted the need to equip future educators with essential skills for an online learning environment. This study aims to address this gap by developing and validating a scale to measure pre-service teacher competency in an online learning context using the scenario method. After a…

Child self-regulation has been considered a valuable skill that shapes a child's future life trajectory. Parents have crucial roles in its development, making parenting interventions a strategic means to promote child self-regulation. Nonetheless, there are no available measures of child self-regulation suitable for assessing outcomes in…

There has been growing interest in incorporating point-of-care ultrasound (POCUS) into the curriculum of medical schools. In this study, we describe a condensed version of the 4-view cardiac assessment and assess its reliability and validity in pre-clerkship medical students at Boston University Aram V. Chobanian & Edward Avedisian School of…

The aim of this study is to develop a valid and reliable scale that can be used to assess teachers' digital competencies. The research employed a survey design, one of the quantitative research methods. The sample of the study consisted of 463 teachers from various disciplines working in Kayseri during the 2023-2024 academic year. Initially, a…

This study aims to develop a financial literacy scale that can be used to assess the level of financial literacy among university students and the relevant age group. This study employs quantitative research methods and is a scale development study. The study group consists of 580 students enrolled at a state university during the 2023-2024…

An increasing number of language testing companies are developing and deploying deep learning-based automated essay scoring systems (AES) to replace traditional approaches that rely on handcrafted feature extraction. However, there is hesitation to accept neural network approaches to automated essay scoring because the features are automatically…