The push for accountability in public schooling has extended to the measurement of teacher performance, accelerated by federal efforts through Race to the Top. Currently, a large number of states and districts across the country are computing measures of teacher performance based on the standardized test scores of their students and using them in…

Testing factorial invariance has recently gained more attention in different social science disciplines. Nevertheless, when examining factorial invariance, it is generally assumed that the observations are independent of each other, which might not be always true. In this study, we examined the impact of testing factorial invariance in multilevel…

This study explored the impact of partial credit scoring of one type of innovative items (multiple-response items) in a computerized adaptive version of a large-scale licensure pretest and operational test settings. The impacts of partial credit scoring on the estimation of the ability parameters and classification decisions in operational test…

The Council for the Accreditation of Educator Preparation (CAEP) requires faculty from educator preparation programs to provide evidence of credential candidates' impact on K-12 student learning. However, there is a paucity of information on preparation programs' use of direct assessments of student learning to gauge credential candidate…

We consider the estimation of probabilistic ranking models in the context of conjoint experiments. By using approximate rather than exact ranking probabilities, we avoided the computation of high-dimensional integrals. We extended the approximation technique proposed by Henery (1981) in the context of the Thurstone-Mosteller-Daniels model to any…

In this paper, the author talks about Faster Forward Fund (3F). The basic idea of 3F is to provide support for three approaches within the evaluation field that are not the main foci of AEA activities, or of any other organization as far as is known: (1) to develop ideas that show promise for significantly accelerating the theory or practice of…

Evaluation occurs within a specific context and is influenced by the economic, political, historical, and social forces that shape that context. The culture of evaluation is thus very much embedded in the culture of accountability that currently prevails in public sector institutions, policies, and program. As such, our understanding of the…

Interest inventories and career assessments continue to be used to support practitioners as they work to uncover client interests, abilities, skills, motivations, values, and other personal factors that help individuals self-define and construct their career. The skilled use of career inventories and assessments remains a minimum competency of…

Excellence and equity goals motivate much of American educational policy. These two goals are not always mutually reinforcing. Some policies boost average academic achievement even as they broaden educational inequalities. Others depress academic achievement even as they narrow inequalities. The twin goals of excellence and equity should lead…

Comparability between different educational qualifications is an important issue within policy discourse in the UK. In this context, the comparability of qualification demands has been explored through the use of expert human judgement. The involvement of human judgement in estimating assessment demands has consequences for methodology. This…

Multiple-indicators multiple-causes (MIMIC) modeling is often used to test a latent group mean difference while assuming the equivalence of factor loadings and intercepts over groups. However, this study demonstrated that MIMIC was insensitive to the presence of factor loading noninvariance, which implies that factor loading invariance should be…

The examination of cross-classified category data is common in evaluation and research, with Karl Pearson's family of chi-square tests representing one of the most utilized statistical analyses for answering questions about the association or difference between categorical variables. Unfortunately, these tests are also among the more commonly…

Purpose: In the higher education sector, the evaluation of learning and teaching projects is assuming a role as a quality and accountability indicator. The purpose of this paper is to investigate how learning and teaching project evaluation is approached and critiques alignment between evaluation theory and practice. Design/Methodology/Approach:…

The purpose of this article is to understand the function, logic, and impact of qualitative systems for analyzing text complexity, focusing on their benefits and imperfections. We identified two primary functions for their use: (a) to match texts to reader ability so that readers read books that are within their grasp, and (b) to unearth, and then…

Purpose: The Comprehensive Assessment of Leadership for Learning (CALL) is an online task-based assessment of distributed instructional leadership. In developing CALL, researchers faced the challenge of structuring survey items that would measure leadership practice rather than individual traits. Critical in this work was developing items that…