Purpose: The primary objective of this research paper was to examine the objectivity of the preselected items evaluation (PIE) method, a prevalent translation scoring method deployed by international institutions such as UAntwerpen, UGent and the University of Granada. Design/methodology/approach: This research critically analyzed the scientific…

Measurement invariance (MI) is an essential part of validity evidence concerned with ensuring that tests function similarly across groups, contexts, and time. Most evaluations of MI involve multigroup confirmatory factor analyses (MGCFA) that assume simple structure. However, recent research has shown that constraining non-target indicators to…

Since 2018, institutions of higher education have been aware of the "enrollment cliff" which refers to expected declines in future enrollment. This paper attempts to describe how prepared institutions in Ohio are for this future by looking at trends leading up to the anticipated decline. Using IPEDS data from 2012-2022, we analyze trends…

As evidence from evaluation and experimental studies continue to influence decision and policymaking, applied researchers and practitioners require tools to derive valid and credible inferences. Over the past several decades, research in causal inference has progressed with the development and application of propensity scores. Since their…

Appetite for entrepreneurship education (EE) among vocational students has surged dramatically, driven by persistent challenges of unemployment. As a result, vocational institutions are increasingly focused on how much entrepreneurship exposure students receive, particularly how frequently instructors impart core business knowledge and skills to…

Considerable literature is devoted to teachers' assessment use to support teaching and learning. The study examined the factor structure of a measure of teachers' assessment use along the assessments "of", "for", and "as" learning purpose dimensions. The study also examined the factor structure of teachers' perceived…

The remarkable strides in artificial intelligence (AI), exemplified by ChatGPT, have unveiled a wealth of opportunities and challenges in assessment. Applying cutting-edge large language models (LLMs) and generative AI to assessment holds great promise in boosting efficiency, mitigating bias, and facilitating customized evaluations. Conversely,…

Given the rapid adoption of machine learning methods by education researchers, and the growing acknowledgment of their inherent risks, there is an urgent need for tailored methodological guidance on how to improve and evaluate the validity of inferences drawn from these methods. Drawing on an integrative literature review and extending a…

The rise of artificial intelligence (AI) is transforming educational practices, particularly in assessment. While AI may support the students in idea generation and summarization of source materials, it also introduces challenges related to content validity, academic integrity, and the development of critical thinking skills. Educators need…

Surveys are typical for student evaluation of teaching (SET). Survey research consistently confirms the negative impacts of careless responses on research validity, including low data quality and invalid research inferences. SET literature seldom addresses if careless responses are present and how to improve. To improve evaluation practices and…

This was the first study in which a psychometrically validated STEM measure, the "Student STEM" (S-STEM), was studied for HSSWD. This study also represented the first time a psychometrically validated STEM measure, the "Student STEM" (S-STEM), was studied for HSSWD. Data were collected from 229 HSSWD in a western state and…

Internal and external factors influence teachers' daily assessment decisions. The purposes of teachers' assessments are crucial, as these purposes guide the assessment process. Still, little is known about teachers' assessment purposes. The aim of this study is to identify and describe the different purposes of assessments that Civics teachers…

Despite the enabling role of teacher feedback literacy in students' engagement with feedback, little empirical research has explored the internal structure of this construct and its influencing factors. This paper developed and validated a teacher feedback literacy scale for pre-service teachers and examined its influencing factors (i.e.…

This article aims to study the performance of machine learning models in forecasting gender based on the students' open education competency perception. Data were collected from a convenience sample of 326 students from 26 countries using the eOpen instrument. The analysis comprises 1) a study of the students' perceptions of knowledge, skills, and…

The rapid advancement of digital technology has not only affected the world of work but also students' learning. Digital learning competence (DLC) is one of the essential skills students need for effective learning in a digital environment. Despite the significant presence of secondary vocational school students in China, constituting one-third of…