Validity in psychometrics refers to the degree to which evidence and theory supports the interpretations drawn from a test, and Messick's Contemporary Validity Theory (1994) includes several facets with well-established evidence collection methods. However, there is a lack of consensus on appropriate methods of evaluating the facet of…

In many psychological and educational applications, it is imperative to obtain valid and reliable score estimates of multilevel processes. For example, in order to assess the quality and characteristics of high impact learning processes, one must compute accurate scores representative of student- and classroom-level constructs. Currently, there…

With adolescent mental health concerns on the rise, it is important that school counselors provide adequate support in the areas of academic, career, and social/emotional support. Yet, there are few scales that look at the perceptions of students around the support that their school counselors provide in these areas. This study sought to validate…

Reliability indicates the internal consistency of a test. In educational studies, reliability is a key feature for a test. Researchers have proposed many traditional reliability estimates, such as coefficient alpha and coefficient omega. However, traditional reliability indices do not deal with the data hierarchy, even though the multilevel…

The Performance Assessment and Evaluation System (PAES) is used by all major universities in the state of Utah to measure the effective teaching skills of preservice candidates as they progress through their teaching preparation program. The resulting ratings are used to make high-stakes decisions relating to course completion as well as…

Background: Children with reading difficulty exhibit deficits in multiple cognitive areas (e.g., language skills, working memory, processing speed). Therefore, evaluation of reading difficulty typically includes assessment of both academic functioning and general intelligence (IQ). Although the IQ construct is considered robust in the general…

This study is meant to explore the psychometric properties of The Self-Advocacy Skills Inventory Beta. The Beta is a measurement of self-advocacy skills for individuals with different disabilities. This dissertation presents the results of a confirmatory factor analysis, as well as an examination of reliability of the Beta as well as its scales.…

Over the decades, counselors have been asked to provide culturally appropriate services to clients and make social justice efforts (American Counseling Association, 2014; Arredondo et al., 1996; Sue et al., 1982). School counselors have also been encouraged to act as social justice leaders who advocate for systemic changes in schools (Curry &…

Previous research has been limited regarding the measurement of computational thinking, particularly as a learning progression in K-12. This study proposes to apply a multidimensional item response theory (IRT) model to a newly developed measure of computational thinking utilizing both selected response and open-ended polytomous items to establish…

Within the field of school psychology, the currently accepted structure of intelligence is the Cattell-Horn-Carroll Model (CHC). The CHC model contains three strata of abilities: a general ability (g), multiple broad cognitive abilities, and several narrow abilities (Schneider & McGrew, 2018), although the theoretical salience of the g factor…

Experienced discrimination based on identity and appearance (or discrimination experience) is critical to assess among the college student population given its relationship to six key components of the college student experience. Investigating this variable requires the use of a psychometrically sound scale that demonstrates adequate validity and…

Quality academic advising has been known to have lasting impacts on student success and persistence in higher education. In 2017, NACADA: The Global Community for Academic Advising established a set of 20 competencies known to be the essential topics that advisors and student success professionals have an understanding of, knowledge of, or skills…

Autism spectrum disorder (ASD) is characterized in the Diagnostic and Statistical Manual of Mental Disorders (DSM-5; APA, 2013) by deficits in social communication and the presence of restricted and repetitive behaviors and interests (RRBIs). Despite the mandatory requirement of both categories of impairment for a diagnosis of ASD, research…

The purpose of this survey study was to explore the factor structure of a newly adapted survey called the Modified Principles of Adult Learning Scale (MPALS) with students at a 4-year Hispanic Serving Institution. The examination of the factor structure of the new instrument was done in order to analyze student perception of professor's…

This sequential-explanatory mixed-methods study assessed the construct validity of the educative Teaching Performance Assessment's (edTPA) Elementary Education Literacy, Elementary Education Math, and Early Childhood assessment areas. The edTPA is a portfolio-based subject-specific teaching performance assessment developed by Stanford's Center for…