Decisions about admissions to medical school are based on assessments of the applicants' cognitive achievements and non-cognitive traits. Admission criteria are expected to be fair, transparent, evidence-based and legally defensible. However, unlike cognitive criteria, which are highly reliable and moderately valid, the reliability and validity of…

Objective: This article reports on the reliability and validity of a new instrument called the Resource Generating Strategies (RGS) Scale, which was created to measure participation in the informal economy. Method: Researchers interviewed 285 adult women who had received domestic violence services, were currently incarcerated, or were residing in…

Objective: The Casey Foster Applicant Inventory-Applicant Version (CFAI-A) is a new standardized self-report measure designed to assess the potential to foster parent successfully. The CFAI-A is described, and results concerning its psychometric properties are presented. Method: Data from a sample of 304 foster mothers from 35 states are analyzed.…

Patient nonattendance to scheduled sessions results in excessive costs to mental health and substance abuse providers and compromises the care of clients. This paper presents a comprehensive review of interventions that have been shown to increase session attendance rates in these settings. Unique to other review papers, reliability estimates were…

Rater biases are of interest to behavior genetic researchers, who often use ratings data as a basis for studying heritability. Inclusion of multiple raters for each sibling pair (M. Bartels, D. I. Boomsma, J. J. Hudziak, T. C. E. M. van Beijsterveldt, & E. J. C. G. van den Oord, 2007) is a promising strategy for controlling bias variance and may…

This study compares five scoring approaches for a test of clinical reasoning skills. All of the approaches incorporate information about the correct item responses selected and the errors, such as selecting too many responses or selecting a response that is inappropriate and/or harmful to the patient. The approaches are combinations of theoretical…

Clinical and health policy research frequently involves health status measurement using generic or disease specific instruments. These instruments are generally developed to arrive at several scales, each measuring a distinct domain of health quality of life (HQOL). Clinical settings are starting to explore how to integrate patient perspectives of…

Among the most knotty problems faced by investigators committed to interpretive practices in disciplines and fields such as sociocultural anthropology, jurisprudence, literary criticism, historiography, feminist studies, public administration, policy analysis, planning, educational research, and evaluation are deciding whether an interpretation is…

The purpose of this study was to examine the psychometric integrity of the "Test of Silent Contextual Reading Fluency" (TOSCRF) by D. D. Hammill, J. L. Wiederholt, and E. A. Allen (2006). The TOSCRF is a recently published assessment of reading fluency for ages 7 years 0 months to 18 years 11 months that can be administered individually or in a…

This paper describes the confirmatory factor analysis, validity, and reliability data collection stage of the development of a scale to measure mainstream teachers' self-efficacy beliefs for teaching ELL (English Language Learner) students. Data were collected from 708 K through 12 teachers and pre-service teachers with varying degrees of…

This article reports on the outcomes from the "e-scape Primary Scientific and Technological Understanding Assessment Project" (2009-2010), which aimed to support primary teachers in developing valid portfolio-based tasks to assess pupils' scientific and technological enquiry skills at age 11. This was part of the wider…

The Test of Spoken English (TSE) is an internationally administered instrument for assessing nonnative speakers' proficiency in speaking English. The research foundation of the TSE examination described in its manual refers to two sources of variation other than the achievement being measured: interrater reliability and internal consistency.…

This annotated bibliography was developed upon noting a deficiency of information in the literature regarding the training of raters for establishing agreement. The ERIC descriptor, "Interrater Reliability", was used to locate journal articles. Some of the 33 resulting articles focus on mathematical concepts and present formulas for computing…

A distinction is made between reliability of measurement and reliability of classification; the "criterion-referenced reliability coefficient" describes the former. Application of this coefficient to the probability distribution of possible scores for a single student yields a meaningful way to describe the reliability of a single score. (Author)

Two five-week test-retest reliability studies of a measure of the unit of perception of ongoing behavior were conducted. In the first, 25 females and 23 males segmented a 7-minute action sequence under fine-unit or gross-unit instructional sets. Number of units marked at first viewing correlated .87 with number of units at retest. Correlations…