This article extends multivariate generalizability theory (MGT) to tests with different random-effects designs for each level of a fixed facet. There are numerous situations in which the design of a test and the resulting data structure are not definable by a single design. One example is mixed-format tests that are composed of multiple-choice and…

Early identification of language delay is important as it has a serious impact on a child's life in terms of educational, social, and emotional development. Among the early language screening tools, there are some parent-administered tools; however, they are not culturally appropriate or freely available. This article documents the development and…

Students in higher education (HE) are required to complete a variety of writing tasks for coursework and examinations. However, for some students writing presents a major challenge. In the UK, the availability of tools for specialist assessors to help identify difficulties with the quality of written composition is limited. The aim of this study…

The current study aimed to measure preservice teachers' skills in implementing pedagogical model of collaborative problem solving (CPS) using a more advanced and novel human-to-agent computerized assessment instrument. By doing so, a framework with three major skills in the implementation of CPS and four major individual problem-solving processes…

The traditional format for neuroanatomy lab practical exams involves stations with a time limit for each station and inability to revisit stations. Timed exams have been associated with anxiety, which can lead to poor performance. In alignment with the universal design for learning (UDL), "Timed Image Question" and "Untimed Image…

C-tests are gap-filling tests mainly used as rough and economical measures of second-language proficiency for placement and research purposes. A C-test usually consists of several short independent passages where the second half of every other word is deleted. Owing to their interdependent structure, C-test items violate the local independence…

Multiple-choice questions (MCQs) are popular in vocabulary software because they can be scored automatically and are compatible with many input devices (e.g., touchscreens). Answering MCQs is beneficial for learning, especially when learners retrieve knowledge from memory to evaluate plausible answer alternatives. However, such retrieval may not…

Purpose: This study compared the test characteristics, test-retest reliability, and test efficiency of three novel digits-in-noise (DIN) test procedures to a conventional antiphasic 23-trial adaptive DIN (D23). Method: One hundred twenty participants with an average age of 42 years (SD = 19) were included. Participants were tested and retested…

Background/purpose: In addition to many competencies of school administrators, the level of intellectuality can increase the commitment of educational actors to the organization in schools with sociocultural diversity, which is considered as a wealth of Turkey. Considering the sociocultural developments of the present day, it is important to know…

This research study explored the systematic thinking modes underlying test anxiety in 706 engineering students through an experiment centred on the cognitive algebra paradigm. The participants had to read 36 experimental scenarios that narrated an imaginary academic assessment situation one by one and then judge the level of anxiety they…

Wide agreement exists about the value and power of learning in social contexts, and social influences on learning have been studied from multiple perspectives. However, before this study, no known measure of the value of learning that happens in social spaces had been developed. This study introduces a scale to measure value created through…

In this three-study investigation, we applied various approaches to score drawings created in response to both Form A and Form B of the Torrance Tests of Creative Thinking-Figural (broadly TTCT-F) as well as the Multi-Trial Creative Ideation task (MTCI). We focused on TTCT-F in Study 1, and utilizing a random forest classifier, we achieved 79% and…

The OECD's PISA program assesses 15-year-old students globally in key competencies every 3 years, providing influential data on education quality and spurring policy debates. In the latest cycle, the innovation domain focused on creative thinking, assessing over 140,000 students across 60+ countries, in the largest study of adolescent creativity…

In this exploratory study, we adapted items from a previously developed measure of job satisfaction, the Measure of Job Satisfaction (MJS), an instrument first developed for use with community nurses in the UK, to create a brief, 15-item instrument (Job Satisfaction--Brief) applicable to practitioners of school psychology from Pennsylvania (N =…

Classroom engagement is a critical factor for evaluating students' learning outcomes and teachers' instructional strategies. Traditional methods for detecting classroom engagement, such as coding and questionnaires, are often limited by delays, subjectivity, and external interference. While some neural network models have been proposed to detect…