Fitting wrongly specified models to observed data may lead to invalid inferences about the model parameters of interest. The current study investigated the performance of the posterior predictive model checking (PPMC) approach in detecting model-data misfit of the hierarchical rater model (HRM). The HRM is a rater-mediated model that incorporates…

Entrustable professional activities (EPAs) and their corresponding entrustment supervision (ES) scales are an innovative education assessment model to provide authentic assessment and growth of health professions education learners. The overall goal of this work is to gain insight into the utility of an EPA framework for assessment within pharmacy…

This dissertation contributes to a better understanding of performance management systems (PMS) by examining adoption, stringency, and impact of performance-based funding (PBF) in public institutions of higher education within the United States. The public sector has been under increasing pressure to be more accountable to stakeholders--that is,…

The primary purpose of this study was to examine how best a Tennessee 4-year public university can perform under the state's outcomes-based funding formula, most commonly identified as either PF 2.0 or the Complete College Tennessee Act (CCTA) funding formula. Using a mixed methods approach, the research analyzed select input variable performance…

The purpose of the study is to examine the two components (CAEP accreditation standards, edTPA pre-service assessment) related to teacher development to determine the common components as well as the disconnects. The method of content analysis was used to complete the comparison. NVivo software was used to code the documents used in the study. The…

This study explores a new comprehensive framework for understanding elements of validity, specifically for performance assessments that are administered within specific and dynamic contexts. The adoption of edTPA is a good empirical case for examining the concept of consequential validity because this assessment has been implemented at the state…

With the online assessment becoming mainstream and the recording of response times becoming straightforward, the importance of response times as a measure of psychological constructs has been recognized and the literature of modeling times has been growing during the last few decades. Previous studies have tried to formulate models and theories to…

This dissertation is comprised of three papers that propose and apply psychometric models to deal with complexities and challenges in large-scale assessments, focusing on modeling rater effects and complex learning progressions. In particular, three papers investigate extensions and applications of multilevel and multidimensional item response…

The purpose of this research is twofold: (a) develop a validated measure for learning initiatives based on knowledge-creation theory and (b) conduct a quantitative study to investigate the relationships between electronic learning systems, learning-organization culture, efficacious knowledge creation (EKC), and innovativeness. Although Cheng-Chang…

Despite the popularity of planned change efforts, the failure rates of implementation are as high as 50 to 70 percent (Lewis & Seibold, 1998). While these efforts are affected by technical issues, the organizations' approach to change, structure, technological capabilities, and organizational culture and communication practices are…

Performance assessments rely on the expert judgment of raters for the measurement of the quality of responses, and raters unavoidably introduce error in the scoring process. Defined as the tendency of a rater to assign higher or lower ratings, on average, than those assigned by other raters, even after accounting for differences in examinee…

Many theories, methods, and practices are utilized to evaluate teachers with the intention of determining teacher effectiveness to better inform decisions about retention, tenure, certification and performance-based pay. In the 21st century there has been a renewed emphasis on teacher evaluation in public schools, largely due to federal "Race…

The purpose of this study was to test a hypothesized model of aurally perceived performer-controlled musical factors that influence assessments of performance quality. Previous research studies on musical performance constructs, musical achievement, musical expression, and scale construction were examined to identify the factors that influence…

This study examined Kirkpatrick's training evaluation model (Kirkpatrick & Kirkpatrick, 2006) by assessing a sales training program conducted at an organization in the hospitality industry. The study assessed the employees' training outcomes of knowledge and skills, job performance, and the impact of the training upon the organization. By…