This paper adopted an analytical perspective to review cognitive engagement measures. This paper provided a comprehensive understanding of the instruments/techniques used to measure cognitive engagement, which could assist researchers or practitioners in improving their measurement methodologies. In particular, we conducted a systematic literature…

The evidence base for educational interventions for deaf students has been, and continues to be, called into question due to a lack of "gold standard" research available to support it. Yet the paucity of research in deaf education is not only in the volume of research that meets rigorous standards but also in its lack of attention to and…

Structured means analysis is a very useful approach for testing hypotheses about population means on latent constructs. In such models, a z test is most commonly used for testing the statistical significance of the relevant parameter estimates or of the differences between parameter estimates, where a z value is computed based on the asymptotic…

De la Torre and Deng suggested a resampling-based approach for person-fit assessment (PFA). The approach involves the use of the [math equation unavailable] statistic, a corrected expected a posteriori estimate of the examinee ability, and the Monte Carlo (MC) resampling method. The Type I error rate of the approach was closer to the nominal level…

Action Research on Measuring Literacy Programme Participants' Learning Outcomes (RAMAA) aims to develop, implement and collaborate on the creation of a methodological approach to measure acquired learning and study the various factors that influence its development. This report examines how RAMAA I has been implemented over the past four years in…

Most states and territories in Australia have adopted the Problem Gambling Severity Index (PGSI) of the Canadian Problem Gambling Index as the standard measure of problem gambling in their prevalence studies and research programs. However, notwithstanding this attempted standardisation, differences in sampling and recruitment methodologies and in…

This study analyzed the reliability and validity of an indirect measure of clarity of feelings that is based on response latencies (RTs) of mood ratings. Fifty-two participants completed a laboratory session and an experience-sampling week with 6 measurement occasions per day. Shorter RT of mood ratings measured in the laboratory (but not…

Background: A literature search found five empirical studies of psychological treatment for adults with ADHD, out of 1,419 articles on ADHD in adults. Practice guidelines to date all recommend multimodal intervention, given that a significant number of patients cannot tolerate, do not respond to, or fail to reach optimal outcomes with medication…

Sampling theory for the intraclass reliability coefficient, a Spearman-Brown extrapolation of alpha to a single measurement for each examinee, is less recognized and less cited than that of coefficient alpha. Techniques for constructing confidence intervals and testing hypotheses for the intraclass coefficient are presented. (SLD)

An approximate statistical test of the equality of two intraclass reliability coefficients based on the same sample of people is derived. Such a test is needed when a researcher wishes to compare the reliability of two measurement procedures, and both procedures can be applied to results from the same group. (SLD)

The literature on measurement reliability shows the consensus that group heterogeneity with regard to the trait being measured is a factor that affects the sample measurement reliability, but the degree of such effect is not entirely clear. Sample performance also has the potential to affect measurement reliability because of its effect on the…

The authors use examples to illustrate how the design of a study conveys the overall strategy and soundness of the investigation. Elements of research design that are discussed include setting, subjects, sample, treatment, measurement, and communication of results. (CT)

Detecting early signs of autism is essential for timely diagnosis and initiation of effective interventions. Several research groups have initiated prospective studies of high-risk populations including infant siblings, to systematically collect data on early signs within a longitudinal design. Despite the potential advantages of prospective…

Kelly's formula estimates sampling variance of correlation corrected for attenuation by using split-half reliabilities. In some cases, coefficient alpha estimate of reliability is preferable. A simulation study suggests a variation of Kelly's formula can be used appropriately with coefficient alpha. Kelly's formula is modified to accept…

Multivariate methods are being used with increasing frequency in educational research because these methods control "experimentwise" error rate inflation, and because the methods best honor the nature of the reality to which the researcher wishes to generalize. This paper: explains the basic logic of canonical analysis; illustrates that…