We discuss properties that association coefficients may have in general, e.g., zero value under statistical independence, and we examine coefficients for 2x2 tables with respect to these properties. Furthermore, we study a family of coefficients that are linear transformations of the observed proportion of agreement given the marginal…

One of the major objectives of large-scale educational surveys is reporting trends in academic achievement. For this purpose, a substantial number of items are carried from one assessment cycle to the next. The linking process that places academic abilities measured in different assessments on a common scale is usually based on a concurrent…

This study was born from the idea that valid comparison research can be conducted with students who are placed into and exempt from required developmental reading courses and that these groups do contain students with similar reading ability. This overlooked population consists of students with placement test scores that hover tightly on either…

In this study, we compared measured maximal heart rate (HRmax) to two different HRmax prediction equations [220-age and 208-0.7(age)] in 52 children ages 7-17 years. We determined the relationship of chronological age, maturational age, and resting HR to measured HRmax and assessed seated resting HR and HRmax during a graded exercise test.…

The comparative format used in ranking and paired comparisons tasks can significantly reduce the impact of uniform response biases typically associated with rating scales. Thurstone's (1927, 1931) model provides a powerful framework for modeling comparative data such as paired comparisons and rankings. Although Thurstonian models are generally…

The aim of the current study is to validate the invariance of major profile patterns derived from multidimensional scaling (MDS) by bootstrapping. Profile Analysis via Multidimensional Scaling (PAMS) was employed to obtain profiles and bootstrapping was used to construct the sampling distributions of the profile coordinates and the empirical…

Aim: The objective of this study was to assess the reliability of a mobility questionnaire (MobQues) that was developed to measure the mobility limitations of children with cerebral palsy (CP) as rated by their parents. A clinical version of the questionnaire, consisting of 47 items (MobQues47), is available, as well as a research version with 28…

A Monte Carlo simulation was conducted to investigate the robustness of 4 latent variable interaction modeling approaches (Constrained Product Indicator [CPI], Generalized Appended Product Indicator [GAPI], Unconstrained Product Indicator [UPI], and Latent Moderated Structural Equations [LMS]) under high degrees of nonnormality of the observed…

In this theoretical paper, I present a short critical review of research on calibration. Based on this conceptual analysis I argue for two extensions of this construct: In addition to traditional applications, the methodology should be transferred to also measure calibration between students' metacognitive control processes (traditionally, only…

The following is a discussion on student level of academic achievement, specifically that of African American learners. The misdiagnosis of Black students having learning disabilities and other disabilities will be examined, and the factors as to why this misdiagnosis occurs so often. Research will be provided as evidence to support this claim, as…

State testing programs today are more extensive than ever, and their results are required to serve more purposes and high-stakes decisions than one might have imagined. Assessment results are used to hold schools, districts, and states accountable for student performance and to help guide a multitude of important decisions. This report describes…

This methodological brief introduces the readers to the propensity score matching method, which can be used for enhancing the validity of causal inferences in research situations involving nonexperimental design or observational research, or in situations where the benefits of an experimental design are not fully realized because of reasons beyond…

This article provides examples of how serious misconceptions can result when only "all student" scores from the National Assessment of Educational Progress (NAEP) are used for simplistic state-to-state comparisons. Suggestions for better treatment are presented. The article also compares Kentucky's eighth grade EXPLORE testing to NAEP…

This report, which has been prepared by Abt Associates for the Institute of Education Sciences' National Center for Education Evaluation and Regional Assistance, takes an important first step in sorting out the implications of relying on state tests for general, student-level measures of reading and math achievement in evaluations of educational…

Case-specificity, i.e., variability of a subject's performance across cases, has been a consistent finding in medical education. It has important implications for assessment validity and reliability. Its root causes remain a matter of discussion. One hypothesis, content-specificity, links variability of performance to variable levels of relevant…