This article compares several procedures in their efficacy for detecting differential item functioning (DIF): logistic regression analysis, the Mantel-Haenszel (MH) procedure, and the modified Mantel-Haenszel procedure by Mazor, Clauser, and Hambleton. It also compares the effect size measures that these procedures provide. In this study,…

This article presents the descriptive results of a statewide evaluation of hotline, advocacy, and counseling services provided to sexual assault victims in Illinois. Collaborative efforts of a multidisciplinary research team and sexual assault service providers resulted in victim-sensitive evaluation measures and data that reflect, for the first…

The completion of the first ten years of this journal is an occasion for review and reflection. The main issues that have been addressed over the ten years are summarized in four main sections: Purposes, International Trends, Quality Concerns and Assessment for Learning. Each of these illustrates the underlying significance of the themes of…

Adult students in higher education comprise a sizeable and expanding group of college and university students. While Sissel, Hansman, and Kasworm (2001) note the dearth of scholarship on adult learners in higher education, this same group of scholars and some of their colleagues have certainly produced a solid foundation of scholarly work on the…

Data in social and behavioral sciences typically possess heavy tails. Structural equation modeling is commonly used in analyzing interrelations among variables of such data. Classical methods for structural equation modeling fit a proposed model to the sample covariance matrix, which can lead to very inefficient parameter estimates. By fitting a…

The effectiveness of the Tabu variable selection algorithm, to identify predictor variables related to a criterion variable, is compared with the stepwise variable selection method and the all possible regression approach. Considering results obtained from previous research, Tabu is more successful in identifying relevant variables than the…

When a college or university needs an assessment instrument, it has two choices: select an existing instrument or develop a new one. Since the cost of instrument development in both time and human resources is often prohibitive, many assessment programs rely on existing instruments. The challenge then becomes choosing one that provides the best…

Program theory-driven evaluation science uses substantive knowledge, as opposed to method proclivities, to guide program evaluations. It aspires to update, clarify, simplify, and make more accessible the evolving theory of evaluation practice commonly referred to as theory-driven or theory-based evaluation. The evaluator in this chapter provides a…

Purpose: The purpose of this paper is to describe the process and lessons learned from an evaluation of "Teen Talk", a health drop in service at Kidbrooke, a state secondary school in Greenwich. Design/methodology/approach: A multi-pronged approach was adopted for the evaluation. This included a questionnaire survey of a sample of 180…

The present essay outlines how mixed methods research can be used to enhance the interpretation of significant findings. First, we define what we mean by significance in educational evaluation research. With regard to quantitative-based research, we define the four types of significance: statistical significance, practical significance, clinical…

Interest in strengthening the impact and value of education research has been growing around the world. Here I outline a view of the nature of "impact" and point to instances where research has had a positive impact in education, but always within a larger social and political framework. A three element "model" of research impact is developed and…

In recent years, some researchers have been turning to children's views as a way to better construct knowledge about children and childhood issues. This article presents, firstly, a brief reflection on the image of child underlying this new perspective in research with children, an image that assumes, first and above all, a strong belief in…

Among the many possible aspects to assessing writing, one of the most problematic is coherence. The problems with marking coherence arise because it is by nature subjective. However, the reasonable probability of several readers reaching a consensus concerning the coherence of a text suggests that it may be possible to assign relatively reliable…

Objective: This article systematically reviews evidence for interventions that change attitudes toward homosexuals. Method: In all, 17 empirical studies using college and/or university student samples and interventions intended to improve heterosexuals' attitudes toward lesbian, gay, or bisexual individuals are reviewed. Characteristics of the…

The issue of whether professional social workers make better child welfare workers than nonsocial workers is a considerably complex one. Simply determining better is itself a difficult undertaking. For example, does better mean reduced turnover among professionally trained social worker child welfare specialists, or should it mean better outcomes…