Even though rater-based judgements of clinical competence are widely used, they are context sensitive and vary between individuals and institutions. To deal adequately with rater-judgement unreliability, evaluating the reliability of workplace rater-based assessments in the local context is essential. Using such an approach, the primary intention…

This article contrasts 2 approaches to analyzing transitivity of preference and other behavioral properties in choice data. The approach of Regenwetter, Dana, and Davis-Stober (2011) assumes that on each choice, a decision maker samples randomly from a mixture of preference orders to determine whether "A" is preferred to "B." In contrast, Birnbaum…

Building on previous arguments for why educational researchers should not provide effect-size estimates in the face of statistically nonsignificant outcomes (Robinson & Levin, 1997), Onwuegbuzie and Levin (2005) proposed a 3-step statistical approach for assessing group differences when multiple outcome measures are individually analyzed…

Supplementary methods for the analysis of the Delis-Kaplan Executive Function System (Delis, Kaplan, & Kramer, 2001) are made available, including (a) quantifying the number of abnormally low achievement scores exhibited by an individual and accompanying this with an estimate of the percentage of the normative population expected to exhibit at…

The purpose of this simulation study was to assess the performance of latent variable models that take into account the complex sampling mechanism that often underlies data used in educational, psychological, and other social science research. Analyses were conducted using the multiple indicator multiple cause (MIMIC) model, which is a flexible…

Gifted students often fail to achieve at a superior level in one or more academic areas. In this reply to an article by Assouline, Nicpon, and Whiteman, the author reviews various explanations for this phenomenon, including motivation/interest, learning opportunities, and error in measuring students' ability-achievement discrepancies. The author…

The use of web-based surveys to gather information from teachers has become increasingly common primarily based on the premise that they can reduce costs. Yet, relatively, little is known about the quality or cost effectiveness of web-based versus mail surveys for teachers. To study the efficacy of web-based teacher surveys, the author randomly…

Structural equation models are increasingly used as a modeling tool for multivariate time series data in the social and behavioral sciences. Standard error estimators of SEM models, originally developed for independent data, require modifications to accommodate the fact that time series data are inherently dependent. In this article, we extend a…

This paper proposes a structural analysis for generalized linear models when some explanatory variables are measured with error and the measurement error variance is a function of the true variables. The focus is on latent variables investigated on the basis of questionnaires and estimated using item response theory models. Latent variable…

This article proposes that sampling design effects have potentially huge unrecognized impacts on the results reported by large-scale district and state assessments in the United States. When design effects are unrecognized and unaccounted for they lead to underestimating the sampling error in item and test statistics. Underestimating the sampling…

To reduce the high incidence of cervical cancer among Latinas in the United States it is important to understand factors that predict screening behavior. The aim of this study was to test the utility of theory of planned behavior in predicting cervical cancer screening among a group of Latinas. A sample of Latinas (N = 614) completed a baseline…

Purpose: The purpose of this study was to investigate the characteristics of missing physical activity (PA) data of children and youth. Method: PA data from the Chinese City Children and Youth Physical Activity Study ("N" = 2,758; 1,438 boys and 1,320 girls; aged 9-17 years old) were used for the study. After the data were sorted by the…

This study examined the psychometric properties of the Revised Child Anxiety and Depression Scale in a large sample of youth from the Southern United States. The authors aimed to determine (a) if the established six-factor Revised Child Anxiety and Depression Scale structure could be replicated in this Southern sample and (b) if scores were…

The cultural equivalence of psychological outcome measures remains a major area of investigation. The current study sought to test the factor structure and factorial invariance of the Brief Symptom Inventory-18 (BSI-18) with a sample of adult individuals of Mexican descent (N = 923) across nativity status (U.S.- vs. foreign-born), language format…

This paper describes one of the first efforts by the National Assessment of Educational Progress (NAEP) to improve measurement at the lower end of the distribution, including measurement for students with disabilities (SD) and English language learners (ELLs). One way to improve measurement at the lower end is to introduce one or more…