Manipulation checks are an essential component of quality experimental design in motor learning. Guided by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses framework, this methodological systematic review examined the utilization of manipulation checks in focus of attention research. Seventy-eight protocols from four…

A latent variable modeling approach for scale reliability evaluation in heterogeneous populations is discussed. The method can be used for point and interval estimation of reliability of multicomponent measuring instruments in populations representing mixtures of an unknown number of latent classes or subpopulations. The procedure is helpful also…

In this commentary, we offer a set of visual tools that can assist education researchers, especially those in the field of mathematics, in developing cohesiveness from a mixed methods perspective, commencing at a study's research questions and literature review, through its data collection and analysis, and finally to its results. This expounds…

Internationally, the political appetite for educational measurement capable of capturing a metric of value for money and effectiveness has momentum. While most would agree with the need to assess costs relevant to quality to help support better governmental policy decisions about public spending, poorly understood measurement comes with unintended…

In an earlier paper, we presented methods for estimating achievement gaps when test scores are coarsened into a small number of ordered categories, preventing fine-grained distinctions between individual scores. We demonstrated that gaps can nonetheless be estimated with minimal bias across a broad range of simulated and real coarsened data…

Evaluation is a key component to learning about the effectiveness of a program. This article provides descriptive statistics of the newly developed National 4-H Common Measures (science, healthy living, citizenship, and youth development) based on data from 721 California 4-H youth. The measures were evaluated for their reliability and validity of…

Ho and Reardon (2012) present methods for estimating achievement gaps when test scores are coarsened into a small number of ordered categories, preventing fine-grained distinctions between individual scores. They demonstrate that gaps can nonetheless be estimated with minimal bias across a broad range of simulated and real coarsened data…

This study explored motivation and engagement among North American (the United States and Canada; n = 1,540), U.K. (n = 1,558), Australian (n = 2,283), and Chinese (n = 3,753) secondary school students. Motivation and engagement were assessed via students' responses to the Motivation and Engagement Scale-High School (MES-HS). Confirmatory factor…

This guide is designed to help researchers make sure that their research reports include enough information about study measures so that readers can assess the quality of the study's methods and results. The guide also provides examples of write-ups about measures and suggests resources for learning more about these topics. The guide assumes…

Research supports the connection between engagement, achievement, and school behavior across levels of economic and social advantage and disadvantage. Despite increasing interest and scientific findings, a number of interrelated conceptual and methodological issues must be addressed to advance this construct, particularly for designing…

Reviews research on two measures of transference: Q-sort questionnaire measures and psychotherapy process measures. Q-sort, although reliable, lacks validity information. Psychotherapy process measures have reliability and validity. Considerable comparability was found between process measures and operationalized propositions from Freud's…

The coefficient of precision type of reliability originally defined for scalar variables is generalized to vector variables and named vector reliability. The new coefficient ranges from zero to one. Additional basic properties of vector reliability are derived. Vector information is defined as a simple function of vector reliability. A number of…

Reviewed 149 studies which measured counselor or therapist competencies and examined them for evidence of the reliability and validity associated with the assessment instruments. Only 43 percent of the measurements included reliability data computed at the time they were used, and only 12 percent were accompanied by evidence of their validity.…

The dearth and inadequacy of measurement instruments to assess racial attitudes in children of preschool age provided the impetus for an empirical study that examined four types of commonly used racial attitude measurement instruments and, at the same time, provided information on racial attitudes among preschoolers. Subjects of the study were 36…