In educational tests, a group of questions related to a shared stimulus is called a testlet (e.g., a reading passage with multiple related questions). Use of testlets is very common in educational tests. Additionally, computerized adaptive testing (CAT) is a mode of testing where the test forms are created in real time tailoring to the test…

This dissertation aims to bridge the gap between validity theory and the practice of validation. The dissertation employs a three-article approach. Following the introduction in Chapter I, three independent manuscripts representing three empirical studies are presented (i.e., Chapters II - IV). Each chapter is a stand-alone publishable manuscript,…

Aberrant behavior refers to any type of unusual behavior that would not be expected under normal circumstances. In educational and psychological testing, such behaviors have the potential to severely bias the aberrant examinee's test score while also jeopardizing the test scores of countless others. It is therefore crucial that aberrant examinees…

This dissertation was designed to provide current information on the job satisfaction and organizational commitment of those identifying as women of color working in offices of academic testing. Faced with systemic oppression due to race and gender, women of color have opted in to a profession that is viewed by some as a threat and barrier to the…

Binary item response theory (IRT) models are widely used in educational testing data. These models are not perfect because they simplify the individual item responding process, ignore the differences among different response patterns, cannot handle multidimensionality that lay behind options within a single item, and cannot manage missing response…

Legislation leading to the mandating of accountability testing in schools was chronicled between the publication of "A Nation at Risk" (1983) to the conclusion of No Child Left Behind (2016). Involvement in education by the federal government increased throughout the educational legislation during this time period. The Omnibus Trade and…

This three-paper dissertation explores item cluster-based assessments, first in general as it relates to modeling, and then, specific issues surrounding a particular item cluster-based assessment designed. There should be a reasonable analogy between the structure of a psychometric model and the cognitive theory that the assessment is based upon.…

The present study explored the dimensionality of cognitive structure from two approaches. The first approach used a famous relation between Visual Spatial Working Memory (VSWM) and calculation to demonstrate the multidimensional item response analyses when true dimensions are unknown. The second approach explored the detectability of dimensions by…

The purpose of this study was to examine the difference in student success by retained students who participate in the Hamblen County (Tennessee) Credit Recovery Program [HCCRP] in the year prior and following their participation. HCCRP is an alternative intervention for students who have been retained in the middle grades of Hamblen County School…

Educational and psychological constructs are normally measured by multifaceted dimensions. The measured construct is defined and measured by a set of related subdomains. A bifactor model can accurately describe such data with both the measured construct and the related subdomains. However, a limitation of the bifactor model is the orthogonality…

This mixed-methods case study focuses on the third through fifth grade classrooms at a public elementary school in a Midwestern urban school district where the Northwest Evaluation Association's (NWEA) Measures of Academic Progress (MAP) assessment is being implemented. According to the school district, the goals of these tests are: to show…

In measurement research, data simulations are a commonly used analytical technique. While simulation designs have many benefits, it is unclear if these artificially generated datasets are able to accurately capture real examinee item response behaviors. This potential lack of comparability may have important implications for administration of…

Taking a test often leads to enhanced later memory for the tested information, a phenomenon known as the "testing effect". This memory advantage has been reliably demonstrated with recall tests but not multiple choice tests. One potential explanation for this finding is that multiple choice tests do not rely on retrieval processes to the same…

Classification testing has been widely used to make categorical decisions by determining whether an examinee has a certain degree of ability required by established standards. As computer technologies have developed, classification testing has become more computerized. Several approaches have been proposed and investigated in the context of…

The city of New Orleans has embarked on an historic experiment reinventing its schools--once considered among the worst in the country--from a centralized, single district model of education to a two district model in which both the Recovery School District (RSD) and the preexisting Orleans Parish School Board (OPSB) both operate direct run and…