The reliability of assessment tools is critical for accurately monitoring student performance in various educational contexts. When multiple assessments are combined to form an overall evaluation, each assessment serves as a data point contributing to the student's performance within a broader educational framework. Determining composite…

There has been growing interest in incorporating point-of-care ultrasound (POCUS) into the curriculum of medical schools. In this study, we describe a condensed version of the 4-view cardiac assessment and assess its reliability and validity in pre-clerkship medical students at Boston University Aram V. Chobanian & Edward Avedisian School of…

To determine the effects of explicit instruction (EI) and potential moderators in second/foreign language (L2) teaching, this study meta-analyzed 28 primary reports (a total of 67 unique samples, N = 3754). The main results show that EI was significantly effective in facilitating L2 development, with effect sizes ranging from moderate to large…

Retrospective confidence refers to the phenomenological experience of the level of certainty that retrieved information is, in fact, correct. Retrospective confidence judgments are examined across a range of sub-disciplines in psychology from perception to memory research, and in education and legal applications. This paper focuses on…

This study aims to generalize the reliability of the GAAIS, which is known to perform valid and reliable measurements, is frequently used in the literature, aims to measure one of today's popular topics, and is one of the first examples developed in the field. Within the meta-analytic reliability generalization study, moderator analyses were also…

The purpose of this article is to discuss reliability and precision through the lens of a modern measurement approach, item response theory (IRT). Reliability evidence in the field of counseling is primarily generated using Classical Test Theory (CTT) approaches, although recent studies in the field of counseling have shown the benefits of using…

Generative artificial intelligence technologies, such as ChatGPT, bring an unprecedented change in education by leveraging the power of natural language processing and machine learning. Employing ChatGPT to assist with marking written assessment presents multiple advantages including scalability, improved consistency, eliminating biases associated…

The UK's STEM skills gap is a pervasive issue, manifesting as a marked shortage of skilled workers in these sectors. This shortage poses significant challenges for employers, who find it increasingly difficult to fill job vacancies with qualified candidates. The gravity of this problem has not gone unnoticed, with the government launching…

Within the frequentist structural equation modeling (SEM) framework, adjudicating model quality through measures of fit has been an active area of methodological research. Complicating this conversation is research revealing that a higher quality measurement portion of a SEM can result in poorer estimates of overall model fit than lower quality…

Purpose: Multisite mediation studies are a cornerstone in mapping out developmental processes because they probe the mechanisms of a treatment while creating key opportunities to learn from and about variation in those mechanisms across sites. Despite the prevalence of multisite studies, a significant gap in the literature is how to plan such…

In this paper, we explore measurements of design creativity through metrics related to the processes used in designing and relate them to the metrics used in psychology for idea creativity, ie, novelty and fluency. Our goal was to test the reliability of psychometric measures of creativity to assess creativity in team design. We studied 19 teams…

Dependability (also known as consistency) is one of four criteria in rigor and trustworthiness in qualitative research. In this article, the process of establishing consistency is discussed through the lenses of constructivism and interpretivism, as the observed social reality is viewed as epistemologically counter-intuitive. Two strategies were…

Purpose: Most neural and physiological research on stuttering focuses on the fluent speech of speakers who stutter due to the difficulty associated with eliciting stuttering reliably in the laboratory. We previously introduced an approach to elicit stuttered speech in the laboratory in adults who stutter. The purpose of this study was to determine…

Data science, as a discipline can be used in any area. However, in order to utilize data science techniques, data scientist must be taught domain knowledge, referred to as a partner discipline, in the area with which the techniques are to be utilized. Using a quantitative analysis of publicly available information and survey methodology, this…

This phenomenology research aims to examine prospective elementary mathematics teachers' proving and proof evaluation and their thoughts on convincing according to proof type and argument type. The participants were eight prospective teachers. The data collection tools were semi-structured group interviews, interviews video recordings and the…