Despite the increasing interest in using AI tools as assistant agents in instructional settings, the effectiveness of ChatGPT, the generative pretrained AI, for evaluating the accuracy of second language (L2) writing has been largely unexplored in formative assessment. Therefore, the current study aims to examine how ChatGPT, as an evaluator,…

This technical manual provides an overview of the Mosaic™ by ACT®: Social Emotional Learning Screener. The Mosaic by ACT: Social Emotional Learning Screener (hereafter referred to as the Screener) assesses the social emotional skills of students in elementary school (Grades 3-5), middle school (Grades 6-8), and high school (Grades 9-12). Each…

The aim of the study was to determine the convergent validity of a portable polysomnograph and an accelerometer for measuring sleep efficiency and movement in college students. Volunteers were 29 healthy students (males = 15, females = 14) who simultaneously wore the Nox T3 portable polysomnograph and the ActiGraph wGT3X-BT accelerometer. Both…

This study evaluated agreement in activity outcomes from ActiGraph accelerometers worn on both wrists in a laboratory and free-living setting. Part 1: Thirty-seven participants (25.5 ± 10.5 years) completed laboratory activities. Part 2: Thirty-nine participants (28.5 ± 9.8 years) wore accelerometers for 7 days. Outcomes included average…

Pairwise comparison is becoming increasingly popular as a holistic measurement method in education. Unfortunately, many comparisons are required for reliable measurement. To reduce the number of required comparisons, we developed an adaptive selection algorithm (ASA) that selects the most informative comparisons while taking the uncertainty of the…

In recognition of the capability of text-mining models to quantify aspects of language use, some creativity researchers have adopted text-mining models as a mechanism to objectively and efficiently score the Originality of open-ended responses to verbal divergent thinking tasks. With the increasing use of text-mining models in divergent thinking…

Following 20 years of publishing rank and reputation scores for Canada's 49 institutions of higher education, the present analysis tested five hypotheses: (1) rank and reputation should be positively correlated across schools for each year; (2) rank and reputation should be positively correlated across the 20 years for each school; (3) a school's…

Anthropometry is important for predicting sports performance. While 3-dimensional (3D) body scanners increase the feasibility of anthropometric assessment, reliability data on athletes are lacking. The aim of this study was to determine the test-retest reliability of a portable, single-camera 3D body scanning system (Styku S100) to assess…

An overview of the evolution of career information in light of the changing nature of the world of work is presented. Owing to the constant fundamental changes in the labour market, the distribution of paid work has been also constantly changing. In this article, a more dynamic and -- often temporary -- interplay between citizens and their…

Validity, reliability, and fairness are three prominent indicators for evaluating the quality of assessment processes. Each of the indicators is most often written about and applied in the context of large-scale assessment. As a result, the technical properties of these indicators make them limited in both their practicality and relevance for…

Background: This article describes the development and use of the Formulation Understanding Measure to evaluate team formulation with staff supporting people with intellectual disabilities. Method: A quantitative design with an opportunistic sample was used to evaluate the psychometric properties of the Formulation Understanding Measure (FUM)…

Notions of research quality are contextual in many respects: they vary between fields of research, between review contexts and between policy contexts. Yet, the role of these co-existing notions in research, and in research policy, is poorly understood. In this paper we offer a novel framework to study and understand research quality across three…

Grades serve as one of the primary indicators of student learning, directing subsequent actions for students, instructors, and administrators, alike. Therefore, grade validity--that is, the extent to which grades communicate a meaningful and credible representation of what they purport to measure--is of utmost importance. However, a grade cannot…

To explore the psychometric properties of the Greek version of the World Health Organization Disability Assessment Schedule (WHODAS 2.0-12 item) in adult patients suffering from motor disabilities. The questionnaire of WHODAS 2.0-12 item was officially translated and cross-culturally adapted into Greek (WHODAS 2.0-12Gr). 136 adult patients with…

In this digital ITEMS module, Dr. Robert [Bob] Mislevy and Dr. Maria Elena Oliveri introduce and illustrate a sociocognitive perspective on educational measurement, which focuses on a variety of design and implementation considerations for creating fair and valid assessments for learners from diverse populations with diverse sociocultural…