Validity of performance standards is a key element for the defensibility of standard setting results, and validating performance standards requires collecting multiple pieces of evidence at every step during the standard setting process. This study employs a statistical procedure, latent class analysis, to set performance standards and compares…

The Campbellian validity typology has been used as a foundation for outcome evaluation and for developing evidence-based interventions for decades. As such, randomized control trials were preferred for outcome evaluation. However, some evaluators disagree with the validity typology's argument that randomized controlled trials as the best design…

We have maintained the customer grade system that is being implemented to customers with excellent performance through customer segmentation for years. Currently, financial institutions that operate the customer grade system provide similar services based on the score calculation criteria, but the score calculation criteria vary from the financial…

The aim of this study is to profile academic institutions (n = 127) based on publications, citations in the top 10% of journals, patent citations in Food and Drug Administration (FDA) approvals, clinical trials with uploaded results, contributions to clinical practice guidelines, awarded patents, start-ups, and licenses generating income in…

In exploratory factor analysis, although the researchers decide which items belong to which factors by considering statistical results, the decisions taken sometimes can be subjective in case of having items with similar factor loadings and complex factor structures. The aim of this study was to examine the validity of classifying items into…

A method for evaluating the validity of multicomponent measurement instruments in heterogeneous populations is discussed. The procedure can be used for point and interval estimation of criterion validity of linear composites in populations representing mixtures of an unknown number of latent classes. The approach permits also the evaluation of…

This paper argues that the dominant framework for conceptualizing validation evidence and analysis--the "five sources" framework from the 1999 "Standards"--is seriously limited. Its limitation raises a significant barrier to understanding the nature of comprehensive validation, and this presents a significant threat to…

When education works, it creates productive, innovative citizens eager to contribute to a well-functioning democracy. In contrast, educational failure has lifelong consequences, with some individuals experiencing decades of preventable hardship. Dawn Flanagan and Joel Schneider write in this response that, like Kranzler, Floyd, Benson, Zabowski,…

This article examines the validity of IQ-achievement discrepancy and low achievement as criteria for the identification of disabilities in Spanish-speaking English-language learners (ELs) and the factors that moderate the validity of these approaches as bases for identification. While there has been a long history of examining the validity of…

This article examines the validity of IQ-achievement discrepancy and low-achievement as criteria for the identification of disabilities in Spanish-speaking ELs and the factors that moderate the validity of these approaches as bases for identification. While there has been a long history of examining the validity of different approaches to…

Database files and additional log files of Learning Management Systems (LMSs) contain an enormous volume of data which usually remain unexploited. A new methodology is proposed in order to analyse these data both on the level of both the courses and the learners. Specifically, "regression analysis" is proposed as a first step in the…

"The U21 Ranking of National Higher Education Systems" released in May 2012 is a new player on the scene of university rankings, after ARWU, QSWUR and THEWUR, but with a different perspective--that of whole nations. It has some new features that enhance its validity, but it also shares some of the conceptual and methodological problems…

This paper reviews current proposals concerning the definition of dyslexia and contrasts it with reading comprehension impairment. We then discuss methods for early identification and review evidence that teacher assessments and ratings may be valid screening tools. Finally, we argue that interventions should be theoretically motivated and…

This research investigates the reliability and validity of three major publications' rankings of MBA programs. Each set of rankings showed reasonable consistency over time, both at the level of the overall rankings and for most of the facets from which the rankings are derived. Each set of rankings also showed some levels of convergent and…

To compare two modes of administration (self-administered; by interviewer) and two response options format (using words; images of "facial-expressions") of the first question of SF-36 (Q1SF-36), and to test its validity. We included 825 participants (20-90 years). Q1SF-36, using words or images, was included in a global questionnaire interview and…