Research in the social and behavioral sciences relies on a wide range of experimental and quasi-experimental designs to estimate the causal effects of specific programs, policies, and events. In this paper we highlight measurement issues relevant to evaluating the validity of causal estimation and generalization. These issues impact all four…

The observation systems being used in all 50 states require administrators to learn to accurately and reliably score their teachers' instruction using standardized observation systems. Although the literature on observation systems is growing, relatively few studies have examined the outcomes of trainings focused on developing administrators'…

As diagnostic classification models become more widely used in large-scale operational assessments, we must give consideration to the methods for estimating and reporting reliability. Researchers must explore alternatives to traditional reliability methods that are consistent with the design, scoring, and reporting levels of diagnostic assessment…

There is a critical need for high-quality clinical outcome assessments to capture the important aspects of communication ability of individuals with Angelman syndrome (AS). To center the perspective of caregivers, our team developed the novel Observer-Reported Communication Ability (ORCA) measure using best practice guidelines, with the goal of…

Background: Appropriate diagnosis of sleep problems is crucial, given the importance of sleep in childhood development. The Sleep Self-Report Scale (SSRS) is used to assess children's sleep problems in the United States and Spain, and this study aimed to expand the usability of this instrument by evaluating its validity and reliability in Turkish…

A principals' school management imaginative capability is the cornerstone of visionary leadership. Based on the imagination theory, this study constructed a Principal's School Management Imaginative Capability Scale (PSMICS). Questionnaires were conducted through stratified random sampling. Thirteen hundred and two valid samples were obtained.…

The aims of this reliability generalization study were to provide the overall alpha values of the California critical thinking disposition inventory (CCTDI) total score and subscales scores and investigate the characteristics of the studies that may be associated with the variability in the reliability values of the CCTDI total score and subscales…

This study aims to examine the mediating roles of resilience and occupational self-efficacy in the relationship between occupational stress and subjective well-being and to adapt the Teacher Occupational Self-Efficacy-Short Form (OSS-SF) to Turkish culture. Using a cross-sectional design, convenience sampling was employed to collect the data. The…

The purpose of this study was to investigate a new way of evaluating interrater reliability that can allow one to determine if two raters differ with respect to their rating on a polytomous rating scale or constructed response item. Specifically, differential item functioning (DIF) analyses were used to assess interrater reliability and compared…

Purpose: The purpose of this study was to evaluate the reliability and validity of the Kannada version of the Consensus Auditory-Perceptual Evaluation of Voice (CAPE-V). Method: The Kannada version of CAPE-V comprises six phrases that are phonetically designed as per the CAPE-V requirements. Sixty-five (21 individuals with dysphonia and 44…

Technological mediation has gained relevance in teaching mathematics. Its usefulness and impact depend, to a great extent, on how students approach the learning of the discipline. Two independent instrumental studies were conducted to analyze the psychometric properties of the Spanish version of the Mathematics and Technology Attitudes Scale…

The present study aims to adapt the Technoference in Parent-Child Relationships Scale (TPCRS) to Turkish culture by conducting validity and reliability analyses. The study group consists of the parents of 445 children between the ages of 3 and 6 attending preschool in the Denizli province. Expert opinions were consulted for the language validity…

The aim of this study is to develop a valid and reliable scale to measure the time traps teachers fall into during the teaching-learning process. The sample consists of 234 final-year students continuing their education at the Faculty of Education in the first implementation and 233 pedagogical formation students in the second implementation.…

Educational tests often have a cluster of items linked by a common stimulus ("testlet"). In such a design, the dependencies caused between items are called "testlet effects." In particular, the directional testlet effect (DTE) refers to a recursive influence whereby responses to earlier items can positively or negatively affect…

The knowledge of the materials to be taught to the students is the basic knowledge that preservice mathematics teachers should possess, as they need to prepare themselves for teaching. In order to research preservice teachers' understanding of the subject matter and teaching skils, valid and reliable test instruments are required. Knowledge of…