Even when raters demonstrate agreement in the use of a measure, limited score variability or violation of often-ignored statistical assumptions can result in lower reliability estimates than intuitively expected. This article uses data drawn from two randomized controlled trials of schema therapy and cognitive behavioral therapy for the treatment…

It is a necessity for a researcher to ensure that the validity and reliability of the study is met to prove a discovery. However, there are still qualitative researchers who are still reckless and do not emphasize the concept of validity and reliability when designing, collecting, and analysing the research findings. The quality of a qualitative…

This book provides an overview and discussion of the evidence base of effective school inspections; reflecting on issues of validity and reliability of school inspections in relation to school effectiveness research, unintended consequences and emergent roles and responsibilities of Inspectorates of Education. Chapters include findings from…

This brief provides tips for forming a team of staff and consultants with the needed expertise to make key measurement decisions that will ensure high-quality data for answering the study's research questions. The brief outlines the main responsibilities of measurement team members. It also describes typical measurement tasks and discusses…

This book is relevant for language testers, listening researchers, and oral proficiency teachers, in that it explores four broad themes related to the assessment of L2 listening ability: the use of authentic, real-world spoken texts; the effects of different speech varieties of listening inputs; the use of audio-visual texts; and assessing…

This book explores research on processes that influence family-school partnerships in support of student learning and education. It highlights research related to culture, contexts, and development as families and schools work together to promote smooth transitions and academic achievement. The volume discusses research related to family and…

Background: Youth programs often rely on self-reported data without clear evidence as to the accuracy of these reports. Although the validity of self-reporting has been confirmed among some high school and college age students, one area that is absent from extant literature is a serious investigation among younger children. Moreover, there is…

This study was designed to determine the number of days of pedometer monitoring necessary to achieve reliable and valid estimates of a 1-year average of step counts in adults based on either consecutive days (CD) or random days (RD) of data collection. Twenty-three participants (16 women; M age = 38 years, SD = 9.9) wore a Yamax SW 200 pedometer…

As the education reform movement increasingly focuses on teachers and teaching, educators, policy-makers, and researchers need valid and reliable measures that can be used to evaluate individual teachers, provide guidance for improving teaching performance, and support research in ways that advance instruction and classroom dialog and practice. A…

The most commonly used measures of locus of control are Rotter's Internality-Externality Scale (I-E) and Nowicki and Strickland's Internality-Externality Scale (NSIE). A reliability generalization study is conducted to explore variability in I-E and NSIE score reliability. Studies are coded for aspects of the scales used (number of response…

The impact of biotechnologies on peoples' everyday lives continuously increases. Measuring young peoples' attitudes toward biotechnologies is therefore very important and its results are useful not only for science curriculum developers and policy makers, but also for producers and distributors of genetically modified products. Despite of…

This article discusses how methodological practices can shape and limit how mixed methods is practiced and makes visible the current methodological assumptions embedded in mixed methods practice that can shut down a range of social inquiry. The article argues that there is a "methodological orthodoxy" in how mixed methods is practiced…

A method for point and interval estimation of change in criterion validity of multiple-component measuring instruments as a result of revision is outlined. The procedure is developed within the framework of covariance structure modeling, which complements earlier methods for testing change in composite reliability due to addition or deletion of…

It has been suggested that both internal (e.g., acceptability) and external (e.g., feasibility) factors should be taken under consideration in order to fully understand children's usage of interventions designed to improve their behavior. The purpose of this study was to initiate development of a student self-report measure (Children's Usage…

Meta-analytic reliability generalizations (RGs) are limited by the scarcity of reliability reporting in primary articles, and currently, RG investigators lack a method to quantify the impact of such nonreporting. This article introduces a stepwise procedure to address this challenge. First, the authors introduce a formula that allows researchers…