Comparative accuracy studies evaluate the relative performance of two or more diagnostic tests. As any other form of research, such studies should be reported in an informative manner, to allow replication and to be useful for decision-making. In this study we aimed to assess whether and how components of test comparisons were reported in…

We explore the conditions under which short, comparative interrupted time-series (CITS) designs represent valid alternatives to randomized experiments in educational evaluations. To do so, we conduct three within-study comparisons, each of which uses a unique data set to test the validity of the CITS design by comparing its causal estimates to…

Fuzzy-set qualitative comparative analysis (fsQCA) has become one of the most prominent methods in the social sciences for capturing causal complexity, especially for scholars with small- and medium-"N" data sets. This research note explores two key assumptions in fsQCA's methodology for testing for necessary and sufficient…

The 1961 Copyright Office study on renewals, authored by Barbara Ringer, has cast an outsized influence on discussions of the U.S. 1923-1963 public domain. As more concrete data emerge from initiatives such as the large-scale determination process in the Copyright Review Management System (CRMS) project, questions are raised about the reliability…

Although International Association for the Evaluation of Educational Achievement-pioneered international large-scale assessment (ILSA) of education is now a well-established science, non-practitioners and many users often substantially misunderstand how large-scale assessments are conducted, what questions and challenges they are designed to…

Black and Hispanic students are undeniably underidentified as gifted and underrepresented in gifted education. The underrepresentation of the two largest groups of "minority" students is long-standing, dating several decades, and is a serious area of contention. Most debates focus on the efficacy of traditional intelligence tests with…

Replications and robustness checks are key elements of the scientific method and a staple in many disciplines. However, leading journals in developmental psychology rarely include explicit replications of prior research conducted by different investigators, and few require authors to establish in their articles or online appendices that their key…

This manual provides guidance and documentation for users of the longitudinal kindergarten-fourth grade (K-4) data file of the Early Childhood Longitudinal Study, Kindergarten Class of 2010-11 (ECLS-K:2011). It mainly provides information specific to the fourth-grade round of data collection. The first chapter provides an overview of the…

Background: Clinical trials of medications to alleviate the cognitive and behavioural symptoms of individuals with fragile X syndrome (FXS) are now underway. However, there are few reliable, valid and/or sensitive outcome measures available that can be directly administered to individuals with FXS. The majority of assessments employed in clinical…

In this paper, the writer discusses the philosophical underpinnings of the two dominant research methods in social sciences; quantitative and qualitative paradigms. The natures of two paradigms are quite different so this leads many researchers to discuss these issues in a comparative way. This paper tackles the knowledge and understanding of…

Virtual Comparison Groups (VCG) were developed by the Northwest Evaluation Association as an alternative to conventional controlled experiments for social science researchers working in the field of education. The VCG is generally a group of up to 51 students who are matched, based on key characteristics of the student and school, to a single…

Compared two types of empirical study with two types of conceptual research on the validity of the Rorschach. Argues that the Rorschach does have some validity and that poor research is at least partly culpable for the Rorschach's perceived failure. (Author/BL)

Appplied formulae for estimating the validity of random short forms to Reynolds' data on six short forms of the Marlowe-Crowne. Results showed some, but not all, of the short forms considered by Reynolds were appreciably better than random. (JAC)

Four recent factor analytic studies of the Litwin and Stringer Organizational Climate Questionnaire (LSOCQ) are compared. Although there is somewhat more intra- than inter-organizational replicability of factors, both comparisons raise considerable doubt about the validity of the Litwin and Stringer instrument. (Author)

Contains seven articles discussing the application of meta-analysis to research on outcomes in psychotherapy. Provides a framework for understanding meta-analytic procedures and outlines major techniques. Reviews criticisms of integration of psychotherapy outcome research. Evaluates comparative therapy outcome research and discusses limitations of…