This article discusses how comparability relates to current mainstream conceptions of validity, in the context of educational assessment. Relevant literature was used to consider the relationship between these concepts. The article concludes that, depending on the exact claims being made about the appropriate interpretations and uses of the…

This study compares the psychometric properties of reliability in Classical Test Theory (CTT), item information in Item Response Theory (IRT), and validation from the perspective of modern validity theory for the purpose of bringing attention to potential issues that might exist when testing organizations use both test theories in the same testing…

This paper illustrates similarities and differences between two international surveys that assess adults' skills: the Programme for the International Assessment of Adult Competencies (PIAAC) and the Skills Towards Employment and Productivity (STEP) survey. In particular, the paper highlights the issues that can arise for researchers interested to…

The National Assessment Program -- Literacy and Numeracy (NAPLAN) in Australia is a series of literacy and numeracy tests that are used for purposes of school comparison. This paper argues that a key question for this use lies in whether or not this is a reasonable, or valid, use of the test data. Using Kane's argumentative approach to validity,…

The aim of this paper is to propose an analytical framework of disciplinary learning outcomes that will facilitate our understanding of the nature of disciplines and their relationships. Application of the draft analytical framework, Anderson and Krathwohl's "Taxonomy of Educational Objectives" to engineering learning outcome reference…

Fuzzy-set qualitative comparative analysis (fsQCA) has become one of the most prominent methods in the social sciences for capturing causal complexity, especially for scholars with small- and medium-"N" data sets. This research note explores two key assumptions in fsQCA's methodology for testing for necessary and sufficient…

The 1961 Copyright Office study on renewals, authored by Barbara Ringer, has cast an outsized influence on discussions of the U.S. 1923-1963 public domain. As more concrete data emerge from initiatives such as the large-scale determination process in the Copyright Review Management System (CRMS) project, questions are raised about the reliability…

Elicited imitation (EI) has been widely used to examine second language (L2) proficiency and development and was an especially popular method in the 1970s and early 1980s. However, as the field embraced more communicative approaches to both instruction and assessment, the use of EI diminished, and the construct-related validity of EI scores as a…

There is a need for brief screening instruments for autistic spectrum disorders (ASD) that can be used by frontline healthcare professionals to aid in the decision as to whether an individual should be referred for a full diagnostic assessment. In this study we evaluated the ability of a short form of the autism spectrum quotient (AQ)…

Black and Hispanic students are undeniably underidentified as gifted and underrepresented in gifted education. The underrepresentation of the two largest groups of "minority" students is long-standing, dating several decades, and is a serious area of contention. Most debates focus on the efficacy of traditional intelligence tests with…

"Have We Identified Effective Teachers? Validating Measures of Effective Teaching Using Random Assignment" tested whether a measure created by study authors could identify teachers who are effective at increasing student achievement. The authors used 2009-10 school year data to create a single composite measure of teacher effectiveness;…

Oral language skills are important to consider in school psychology practice, as they are directly tied to many areas of academic functioning. For example, research has demonstrated that oral language skills in early elementary school predict reading comprehension in later grades (Kendeou, van den Broek, White, & Lynch, 2009). With a…

Replications and robustness checks are key elements of the scientific method and a staple in many disciplines. However, leading journals in developmental psychology rarely include explicit replications of prior research conducted by different investigators, and few require authors to establish in their articles or online appendices that their key…

Three self-report measures of the broader autism phenotype (BAP) were evaluated in terms of their internal consistency, distribution of scores, factor structure, and criterion-related validity in a non-clinical sample. All measures showed a continuous distribution. The SRS-A and BAPQ showed expected sex differences and were superior to the AQ in…

We assessed the accuracy of the French version of the "Autism Spectrum Quotient" ("AQ") in adolescents with Asperger syndrome (AS) and high-functioning autism (HFA) compared to healthy controls and adolescents with psychiatric disorders (PDs). Three groups of adolescents, aged 11-18, were assessed: 116 with AS/HFA (93 with IQ…