This paper provides a meta-analytic update on the relationship between intelligence and divergent thinking (DT), as research on this topic has increased, and methods have diversified since Kim's meta-analysis in 2005. A three-level meta-analysis was used to analyze 849 correlation coefficients from 112 studies with an overall N = 34,610. The…

The use of mixed-format tests made up of multiple-choice (MC) items and constructed response (CR) items is popular in large-scale testing programs, including the National Assessment of Educational Progress (NAEP) and many district- and state-level assessments in the United States. Rater effects, or raters' scoring tendencies that result in…

Higher professional education aims to prepare students for professional practice, for which students will need to develop conceptual understanding. Conceptual understanding requires a synthesis of relevant facts, theories and practices. This research explores what types of change take place in students' conceptual understanding during a bachelor…

In evaluating the learning achievement of programming-thinking skills, the method of using a rubric that describes evaluation items and evaluation stages is widely employed. However, few studies have evaluated the reliability, validity, and consistency of the rubrics themselves. In this study, we introduced a statistical method for evaluating the…

This article proposes a class of cognitive diagnosis models (CDMs) for polytomously scored items with different link functions. Many existing polytomous CDMs can be considered as special cases of the proposed class of polytomous CDMs. Simulation studies were carried out to investigate the feasibility of the proposed CDMs and the performance of…

The aim of this study was to develop a rubric as a measurement tool for experiential educators and with this purpose, we investigated a group of the participants on it. Assessing whether the experiential training process follows all four steps of the experiential learning cycle and determining correct or incorrect applications of the experiential…

Originality is scored based on standard zero-originality lists (ZOLs) in the Torrance Tests of Creative Thinking (TTCT). The applicability of those ZOLs to diverse groups has not been examined. We examined the consistency of TTCT-Figural's sample-based (SB) ZOLs and the published ZOLs based on a sample of predominantly African American college…

Forced-choice questionnaires can prevent faking and other response biases typically associated with rating scales. However, the derived trait scores are often unreliable and ipsative, making interindividual comparisons in high-stakes situations impossible. Several studies suggest that these problems vanish if the number of measured traits is high.…

This study presents a latent (item response theory--like) framework of a recently developed classical approach to test scoring, equating, and item analysis, referred to as "D"-scoring method. Specifically, (a) person and item parameters are estimated under an item response function model on the "D"-scale (from 0 to 1) using…

The purpose of this study is to explore the use of unfolding models for evaluating the quality of ratings obtained in rater-mediated assessments. Two different judgmental processes can be used to conceptualize ratings: impersonal judgments and personal preferences. Impersonal judgments are typically expected in rater-mediated assessments, and…

This study investigates the validity and reliability of generative large language models (LLMs), specifically ChatGPT and Google's Bard, in grading student essays in higher education based on an analytical grading rubric. A total of 15 experienced English as a foreign language (EFL) instructors and two LLMs were asked to evaluate three student…

Comparative Judgement (CJ) is an evaluation method, typically conducted online, whereby a rank order is constructed, and scores calculated, from judges' pairwise comparisons of performances. CJ has been researched in various educational contexts, though only rarely in English as a Foreign Language (EFL) writing settings, and is generally agreed to…

This study investigates how PBL enhances students' critical thinking abilities as they compose narrative texts based on indigenous narratives in an English as a Foreign Language (EFL) classroom. The research conducted among 35 ninth-grade students (divided into seven groups) in a public junior high school in Bandung, Indonesia, using qualitative…

In this article, recent developments in the assessment of writing, especially informational writing, are connected with research-based instruction that is likely to have an impact on students with disabilities and the wide range of student writing development in Grades 3 to 8. The objectives are for educators to assess, interpret, and set goals…

The developments in artificial intelligence (AI) have significantly transformed second language (L2) learning and assessment, and the role of AI technologies in L2 assessment have been investigated in recent research. This study presents a bibliosystematic analysis of AI-assisted L2 assessment. Using both systematic analysis and bibliometric…