As methods for automated scoring of constructed-response items become more widely adopted in state assessments, and are used in more consequential operational configurations, it is critical that their susceptibility to gaming behavior be investigated and managed. This article provides a review of research relevant to how construct-irrelevant…

After an extended period of being on the periphery, numerous advancements in the field of second language (L2) pronunciation over the past decade have led to increased activity and visibility for this subfield within applied linguistics research. These positive developments notwithstanding, the vast majority of renewed applied pronunciation…

Assessment pervades the learning process. This paper provides an overview of the application of technology to support and enhance diagnostic, formative and summative assessment. The focus is on examining how it can replace what already exists, improve the functionality, catalyse a redesign of the process and in some circumstances, make possible…

As enrollment of students in online courses has steadily increased over the last few decades, very little attention has been given to online instructor evaluation. This is an area of online education that needs additional research to better ascertain the current state of online instructor evaluation as well as discover ways to improve its…

The purpose of this article is to clarify the discrepancy in the use of "queer" as a sexual identity classification in education survey research. This study extends the work completed by Dugan and Yurman (2011), who empirically demonstrated problems with treating LGB students as a homogenous population through collapsing all respondents…

The bibliometric methodology is an established technique for research evaluation as it offers an objective determination and comparison of research performance. This paper aims to critically assess some standard bibliometric indicators commonly used (based on publication and citation counts) to evaluate academic units, and examine whether there…

At this age of accountability, it is acknowledged that assessment is a powerful lever that can either boost or undermine students' learning. Hitherto, much of the regular institutional and instructional practices show that assessments remain inhibitory or void rather than constructive as these lack the assessment formative aspect. This denotes…

In this article, Michael Quinn Patton pays tribute to Carol Hirschon Weiss, a woman who brought passion to evaluation use. She also brought attention to it, publishing the first article on evaluation in 1967. Weiss' many contributions have come into evaluation currency and overtaken formerly taken-for-granted assumptions. Indeed, her insights…

This article discusses the nonuse, misuse, and proper use of pilot studies in experimental evaluation research. The authors first show that there is little theoretical, practical, or empirical guidance available to researchers who seek to incorporate pilot studies into experimental evaluation research designs. The authors then discuss how pilot…

Like instruments used in afterschool programs to assess children's social and emotional growth or to evaluate staff members' performance, instruments used to evaluate program quality should be free from bias. Practitioners and researchers alike want to know that assessment instruments, whatever their type or intent, treat all people fairly and do…

Evaluators often use qualitative research methods, yet there is little evidence on the comparative cost-effectiveness of the two most commonly employed qualitative methods--in-depth interviews (IDIs) and focus groups (FGs). We performed an inductive thematic analysis of data from 40 IDIs and 40 FGs on the health-seeking behaviors of African…

In Australia, a review of the higher education sector is usually triggered by a change in government leadership, followed by the development and implementation of the government's response in the form of a reform package to enact change. The aim of this study was to conduct an independent evaluation of a large-scale national government policy…

I started my PhD studies in 2012 with a strong interest in student assessment in higher education. By exploring the scholarly field of assessment studies, however, I soon realized that assessment has been most often explored in relation to constructivist approaches to learning and classroom practices. Earlier work done by sociologists saw grades…

Diagnostic language assessment (DLA) is gaining a lot of attention from language teachers, testers, and applied linguists. With a recent surge of interest in DLA, there seems to be an urgent need to assess where the field of DLA stands at the moment and develop a general sense of where it should be moving in the future. The current article, as the…

Three local observed-score kernel equating methods that integrate methods from the local equating and kernel equating frameworks are proposed. The new methods were compared with their earlier counterparts with respect to such measures as bias--as defined by Lord's criterion of equity--and percent relative error. The local kernel item response…