This article calls into question the use of the h-index as an aid to decision-making in the higher education sector. The h-index is increasingly employed by institutions, funding bodies and even governments as a guide to the allocation of resources. This practice is contrary to the evidence that the h-index is intrinsically meaningless, a point…

In this paper, the author aims to provide novice researchers with an understanding of the general problem of validity in social science research and to acquaint them with approaches to developing strong support for the validity of their research. She provides insight into these two important concepts, namely (1) validity; and (2) reliability, and…

The annual Student Outcomes Survey collects information on the outcomes of two groups of students--those that have completed a qualification (graduates) and those that have completed only part of a course and then left the vocational education and training (VET) system (module completers). At the time of selecting the survey sample, insufficient…

This study analyzed the reliability and validity of an indirect measure of clarity of feelings that is based on response latencies (RTs) of mood ratings. Fifty-two participants completed a laboratory session and an experience-sampling week with 6 measurement occasions per day. Shorter RT of mood ratings measured in the laboratory (but not…

The UCLA National Center for Research on Evaluation, Standards, and Student Testing (CRESST) is under contract from the Naval Postgraduate School (NPS) to conduct research on assessment models and tools designed to support Marine Corps rifle marksmanship. In this deliverable, we first review the literature on known-distance rifle marksmanship…

This paper considers the model of school effectiveness (SE) currently dominant in research, policy and practice in England (although the concerns it raises are international). It shows, principally through consideration of initial and propagated error, that SE results cannot be relied upon. By considering the residual difference between the…

Ecological momentary assessment (EMA) is particularly suitable for studying substance use, because use is episodic and thought to be related to mood and context. This article reviews EMA methods in substance use research, focusing on tobacco and alcohol use and relapse, where EMA has been most applied. Common EMA designs combine event-based…

The formula is simple: Highly effective teachers equal student academic success. Yet, the physics of American education is anything but. Thus, the question facing education reformers is how can teacher effectiveness be accurately measured in order to improve the teacher workforce? Given the demand for objective, quantitative measures of teacher…

Emotional and behavioural difficulties (EBD) are common in children, and forecasting their prevalence in schools is of interest to both academic researchers and local authorities. Percentage of pupils eligible for free school meals is one measure often used for this purpose. The article presents the first independent validation of a simple…

Body composition measurements vary greatly in degree of measurement difficulty and accuracy. Hydrostatic weighing, chemical dilution or their equivalents were the accepted "gold" standards for assessing fat mass. Dual Energy X-ray Absorptiometry (DEXA) is fast replacing these techniques as the preferred standard. However, these direct measurement…

Admissions committees and researchers around the globe have used diligence and imagination to develop and implement various screening measures with the ultimate goal of predicting future clinical and professional performance. What works for predicting future job performance in the human resources world and in most of the academic world may not,…

Presents data from two studies determining the validity of various measures of physical activity in preschool children. One explored how certain measures of activity predicted observed behavior. The other examined the Caltrac motion sensor's predictive validity. Results indicate the Caltrac monitor is sensitive to children's individual differences…

The present study was conducted to determine whether combining the results of multiple actuarial risk scales increases accuracy in predicting sex offender recidivism. Multiple methods of combining 4 validated actuarial risk scales--the Violence Risk Appraisal Guide, the Sex Offender Risk Appraisal Guide, the Rapid Risk Assessment for Sexual…

In this technical report, data are presented on the predictive and concurrent relation between various student demographic variables (gender, race/ethnicity, special education status, Title 1 status, English language learning status, and economic disadvantage) and three reading easyCBMs (passage reading fluency, vocabulary, and multiple-choice…

The conceptual, construct, and predictive validity of available instruments for coding relational control is considered in this paper. It approaches conceptual validity by offering a logical analysis that compares each instrument with formative ideas in interactional theory. It then advances data concerning the construct and predictive validity of…