Evaluating the performance of Large Language Models (LLMs) is a critical yet challenging task, particularly when aiming to avoid subjective assessments. This paper proposes a framework for leveraging subjective metrics derived from the class textual materials across different semesters to assess LLM outputs across various tasks. By utilizing…

This study focuses on the practical teaching mode of vocational education under the background of Internet Plus. The traditional model has some problems, such as lack of resources, single method, weak teachers and one-sided evaluation. The internet has brought many positive effects on practical teaching, such as expanding resources, providing…

The Give-N (give-a-number) task has become a popular assessment of children's number words and counting knowledge since Wynn's (1990, 1992) seminal work over 30 years ago. Using the Give-N task, numerous studies have shown that children learn the first few number words slowly, before they understand how counting represents number. This learning…

Background: STEAM education emphasizes transdisciplinary application and practice; however, there is a lack of comprehensive assessment tools for evaluating K-12 students' transdisciplinary learning. Given the cross-domain instructional and learning approaches in STEAM education, this study aims to develop and validate the Learn, Use, Practice,…

This paper looks at the tension between the desire to claim predictive ability for Agent-Based Models (ABMs) and its extreme difficulty for social and ecological systems, suggesting that this is the main cause for the continuance of a rhetoric of prediction that is at odds with what is achievable. Following others, it recommends that it is better…

This article investigates whether there is any place for the school of thought that is known as analytic philosophy of education in the aftermath of postmodernism, and whether analytic philosophy of education can be treated as a 'method', among other alternative 'methods', that can be applied regardless of what kind of '-ism' or ideology one…

The automation of creativity measurement is a promising avenue of development, given that classic creativity assessments face challenges such as resource-intensive expert judgments, subjective creativity ratings, and biases in people's self-reports. In this paper, we present a construct validation study for CollaboUse, a test developed to deliver…

In graduate evaluation education, research has shown that theory to practice is overshadowed by a focus on practical methods which results in evaluation education tension and a tenuous understanding of evaluation theory to practice when evaluators complete their graduate studies. Little is understood about evaluation theory to practice from…

The traditional system focuses excessively on physical skills and physical fitness assessment, with problems such as single indicator, static approach, subject limitation and inefficient data utilization, making it difficult to assess students in a comprehensive and fair manner. The rise of big data technology has brought about a turnaround, from…

Decisions about assessment are often built on myths about teacher professional judgment and subjectivity that prioritize standardized assessment over classroom assessment. Ken O'Connor and Matt Townsley discuss some of the most common myths and explain how to dispel them by developing clear guidelines in which teachers can exercise their judgment,…

Current methods for evaluating faculty teaching fall short, and one way to address this is through campus-wide initiatives that focus on change at the level of academic units. The complex context of higher education makes meaningful teaching evaluation difficult; in particular, four sobering realities of this context must be taken into account in…

Carefully designed evaluations of informal science events are key to gaining insights into their efficacy and impact on audiences. However, traditional approaches to evaluation, such as interviews and questionnaires, can be disruptive to the audience experience of science events. There is therefore a need to develop and implement new evaluation…

Bacteria have developed a cell-to-cell communication system called quorum sensing (QS), allowing them to regulate group behavior and synchronize the expression of virulence factors, responsible for increasing their infection capacity and resistance to antimicrobials. Although the control of microbial infections through the inhibition of microbial…

Researchers continue to choose PCA in scale development and adaptation studies because it is the default setting and overestimates measurement quality. When PCA is utilized in investigations, the explained variance and factor loadings can be exaggerated. PCA, in contrast to the models given in the literature, should be investigated in…

This article delved into the realm of EFL assessment in Iraq by investigating the beliefs of Iraqi EFL teachers about assessment practices they employed in their classroom and determining whether there was any congruency between their beliefs and actual assessment practices. For this purpose, 140 experienced Iraqi EFL teachers were selected by…