The broad autism phenotype is the phenotypic expression of the primary characteristics of autism. However, currently available tests do not agree with the two-domain operationalization of broad autism phenotype or autism, and their internal structure has shown instability across applications. This study presents the Broad Autism…

The present paper questions the content validity of the eight creativity-related self-report scales available in PISA 2022's context questionnaire and provides a set of considerations for researchers interested in using these indexes. Specifically, we point out some threats to the content validity of these scales (e.g., "creative thinking…

In this research report, we describe a study to map the scores of the "TOEFL® Essentials"™ test to the Canadian Language Benchmarks (CLB). The TOEFL Essentials test is a four-skills assessment of foundational English language skills and communication abilities in academic and general (daily life) contexts. At the time of writing this…

Researchers suggest that claims about the meaningfulness of test score interpretations and consequences of test use should be backed by evidence that stakeholders understand the definition of the construct assessed (meaningfulness) and score reports (consequences). Evaluation of stakeholders' actual uses and interpretations of score reports in…

As a replication in the Chinese context of previous aptitude testing validation studies, this research aims at exploring the validity of an interpreting aptitude test battery, composed of the Logical Memory Test (LMT), the Scale of Language Anxiety (SLA) and the Achievement Motivation Test (AMT), in the prediction of consecutive interpreting…

The factor structure of the Wechsler Intelligence Scale for Children--Fourth Edition, Italian adaptation (WISC-IV Itaian; Orsini, Pezzuti, & Picone, 2012; Wechsler, 2012) standardization sample was examined with exploratory factor analytic methods (EFA) not included in the "Technical Manual." Principal-axis extraction followed by…

Large-scale language testing uses statistical information to account for the quality of an assessment system. In this reflection article, I explain how basic statistics can be used meaningfully in the context of classroom language assessment. The paper explores a series of statistical calculations that can be used to examine test scores and…

Background: There is inadequate information regarding the factor structure of the Wechsler Intelligence Scale for Children -- Fifth UK Edition (WISC-V[superscript UK]; Wechsler, 2016a, Wechsler Intelligence Scale for Children-Fifth UK Edition, Harcourt Assessment, London, UK) to guide interpretation. Aims and methods: The WISC-V[superscript UK]…

Profiling students' reading comprehension ability provides essential data to educators to identify students struggling with reading. However, tertiary-level test-takers and test-givers are not always aware of the makeup and design of profiles, which creates real challenges in the use of profiling of test results to diagnose problematic areas in…

The redesigned four-skills "TOEIC Bridge"® tests were designed to measure the listening, reading, speaking, and writing proficiency of beginning to low--intermediate English learners in the context of everyday life. In this paper, I describe two studies that were conducted to investigate claims about the meaningfulness of redesigned…

In this article, the authors applied profile analysis to Maths exam data to demonstrate how different exam forms, differing in difficulty and length, can be reported and easily interpreted. The results were presented for different groups of participants and for different institutions in different Maths domains by evaluating the balance. Some…

The University of Reading Learning Gain project is a three-year longitudinal project to test and evaluate a range of available methodologies and to draw conclusions on what might be the right combination of instruments for the measurement of Learning Gain in higher education. This paper analyses the validity of a measure of critical thinking…

The main purpose of this study was to conduct a validation analysis of student surveys of teaching effectiveness implemented at Bangkok University, Thailand. This study included three phases; survey development, a pilot study, and a full implementation study. Four sources of validity evidence were collected to support intended interpretations and…

Results from Rasch analysis of GCSE and GCE A level data over a period of four years suggest that the standards of examinations in different subjects are not consistent in terms of the levels of the latent trait specified in the Rasch model required to achieve the same grades. Variability in statistical standards between subjects exists at both…

Reading comprehension is often treated as a multidimensional construct. In many reading tests, items are distributed over reading process categories to represent the subskills expected to constitute comprehension. This study explores (a) the extent to which specified subskills of reading comprehension tests are conceptually conceivable to…