This dissertation presents an innovative approach to examining the keying method, wording method, and construct validity on psychometric instruments. By employing a mixed methods explanatory sequential design, the effects of keying and wording in two psychometric assessments were examined and validated. Those two self-report psychometric…

Psychosocial competencies; such as prosocial behaviors, compliance with authority, attention regulation, independence, and emotional regulation; play a crucial role in child development. Higher levels of these competencies in childhood are linked to fewer behavior problems, while deficits in these competencies can predict future problem behaviors.…

Validity in psychometrics refers to the degree to which evidence and theory supports the interpretations drawn from a test, and Messick's Contemporary Validity Theory (1994) includes several facets with well-established evidence collection methods. However, there is a lack of consensus on appropriate methods of evaluating the facet of…

There is a critical national nursing workforce shortage, with estimates of over 200,000 new job openings for Registered Nurses (RNs) annually through 2031 (AACN, 2022). These forecasted workforce needs challenge nursing programs to increase student enrollment (Dowling et al., 2021) while maintaining high-quality education standards. Student…

In Saudi Arabia, mathematics is an essential subject for all freshmen except students majoring in medical sciences. The struggle of students in mathematics is one of the most common issues in the last ten years (Khoshaim, 2015). According to Higbee and Thomas (1999), mathematics self-efficacy, along with other effective characteristics such as…

My dissertation research explored responder behaviors (e.g., demonstrating response styles, carelessness, and possessing misconceptions) that compromise psychometric quality and impact the interpretation and use of assessment results. Identifying these behaviors can help researchers understand and minimize their potentially construct-irrelevant…

The three articles that comprise this dissertation use a variety of methods associated with the field of educational measurement to address distinct research questions related to psychometric tools and their implications for practice in education. All three articles involve methods related to instrument design, while drawing on different…

This dissertation aims to bridge the gap between validity theory and the practice of validation. The dissertation employs a three-article approach. Following the introduction in Chapter I, three independent manuscripts representing three empirical studies are presented (i.e., Chapters II - IV). Each chapter is a stand-alone publishable manuscript,…

Experienced discrimination based on identity and appearance (or discrimination experience) is critical to assess among the college student population given its relationship to six key components of the college student experience. Investigating this variable requires the use of a psychometrically sound scale that demonstrates adequate validity and…

No Child Left Behind (NCLB) cemented a standardized testing assessment culture in the United States but research has highlighted the inequities (Au, 2020; Dixon, 1978; Grodsky et al., 2008; Khan, 2020; Moses & Nanna, 2007), unreliability (Hunt et al., 2010; Pizmony-Levy & Green Saraisky, 2016) and negative impacts (Berryhill et al., 2009;…

This study aimed to provide evidence for the reliability and validity of the "Systems Coaching Survey (SCS)." Systems coaching is an approach to building capacity among groups of educators to drive educational reform efforts by employing seven interdependent sets of skills (interpersonal communication, data-based problem solving, team…

Despite the increasing demand for diagnostic information, observed subscores have been often reported to lack adequate psychometric qualities such as reliability, distinctiveness, and validity. Therefore, several statistical techniques based on CTT and IRT frameworks have been proposed to improve the quality of subscores. More recently, DCM has…

This dissertation investigated predictors of scientific civic engagement among undergraduate students through a multimethod approach, focusing on how educational experiences shaped students' engagement with their communities using scientific skills. This multipart study addressed gaps in understanding how educational practices, identity, and sense…

The emergence of digital-first assessments is prompting reconsideration of, and innovation in, aspects of psychometrics, test validation, and test use. Using the Duolingo English Test (DET) as an example, this three-paper series seeks to address issues concerning the estimation of classification consistency and the reporting of results for such…

The purpose of this mixed-methods research was to develop and validate an instrument to measure teacher self-efficacy for teachers of students with visual impairments (TSVIs). The researcher used a six step process for survey development and validation, which included 1) literature review; 2) a preliminary qualitative study; 3) synthesis of…