This article presents the process of constructing and validating a test of metalinguistic awareness (MLA) for young school children (age 8-10). The test was developed between 2021 and 2023 as part of the MetaLearn research project, financed by The Research Council of Norway. The research team defines MLA as using metalinguistic knowledge at a…

Cognitive load studies are mostly centered on information on perceived cognitive load. Single-item subjective rating scales are the dominant measurement practice to investigate overall cognitive load. Usually, either invested mental effort or perceived task difficulty is used as an overall cognitive load measure. However, the extent to which the…

Recently, psychometricians and researchers have voiced their concern over the exploration of language test items in light of Messick's validation framework. Validity has been central to test development and use; however, it has not received due attention in language tests having grave consequences for test takers. The present study sought to…

The aim of this study was to develop and validate a psychometrically-sound instrument to assess students' perceptions about class cohesion. Two studies were conducted. In Study 1, four steps were established: (1) development of the Class Cohesion Questionnaire (CCQ); (2) item selection; (3) item compression; and (4) exploration of psychometric…

Vocabulary tests administered on multilingual populations should take into account the unique linguistic and cultural makeup of the population by adopting test development methods that allow responses in several languages. Our aims were to develop a picture-naming test for multilingual Lebanese school-age children (L1: Lebanese, L2: French and/or…

The aim of this study is to adapt the Statistics Anxiety Scale (SAS) developed by Vigil-Colet et al. (2008) to Turkish. This study is expected to fill an important gap in the literature since no valid and reliable specific statistics anxiety scale developed or adapted in Turkish for undergraduate students in the literature is available. The sample…

Figural matrices tasks are one of the most prominent item formats used in intelligence tests, and their relevance for the assessment of cognitive abilities is unquestionable. However, despite endeavors of the open science movement to make scientific research accessible on all levels, there is a lack of royalty-free figural matrices tests. The Open…

The aim of this study was to develop a scaling instrument for measuring organizational development level in the Turkish higher education context depending on perceptions of the faculty. The sample consisted of academicians of higher education institutions in the 2020-2021 academic year. Data were gathered in two stages. Exploratory Factor Analysis…

Background: Schools are increasingly measuring school climate and social emotional learning, yet few measures conduct invariance testing by race, gender, or language despite known differences in perceptions of these constructs based on these identities. Objective: This study reports on the validation process of a school climate and social…

The "Participation and Sensory Environment Questionnaire--Teacher Version" (PSEQ-TV) is a teacher report questionnaire designed to examine the impact of the sensory environment on participation for preschool children with autism spectrum disorder (ASD). This study examines the construct validity of the assessment through principal…

Instruments for assessing secondary students' conceptual understanding of core concepts in biology are needed by educational practitioners and researchers alike. Most instruments available for secondary biology (years 9 to 12) focus only on highly specific biological concepts instead of multiple core concepts. This study describes the development…

This article extends the procedure outlined in the article by Raykov, Marcoulides, and Tong for testing congruence of latent constructs to the setting of binary items and clustering effects. In this widely used setting in contemporary educational and psychological research, the method can be used to examine if two or more homogeneous…

The Boxall Profile provides a framework for the structured observation of children in nurture groups. It is a detailed and rigorously trialled normative diagnostic instrument developed for teachers and teaching assistants to measure children's levels of emotional and behavioural functioning. Moreover, it highlights specific targets for…

Existing methods used to validate self-report questionnaires in foreign language teaching effectiveness have relied on Classical Test Theory (CTT). However, the use of CTT approaches limits the reliability and validity of self-report instruments. The Rasch Model, which is based on the principles of objective measurement, addresses some of the…

This study established a Chinese scale for measuring high school students' ocean literacy. This included testing its reliability, validity, and differential item functioning (DIF) with the aim of compensating for the lack of DIF tests focusing on current scales. The construct validity and reliability were verified and tested by analyzing the…