Explores teaching evaluations with a emphasis on student evaluations of teaching effectiveness (SETEs). Discusses the role of SETEs in the scholarship of teaching; addresses their two primary uses, highlighting the difference between global and specific items contained within most instruments; briefly addresses the research on their accuracy;…

Describes and demonstrates analytical techniques used in organizational psychology and contemporary multilevel analysis. Using these analytic techniques, examines the relationship between educational outcomes and the school environment. Finds that at least some indicators might be represented as school-level phenomena. Results imply that the…

Developed and evaluated a model to assess group learning; the model required balanced representation among multiple learning criteria arranged in six goal-criterion sets drawn from the literature on group learning. Administered a test instrument to students and found imbalances among criteria in the six sets which helped identify and correct…

Student test-taking motivation in low-stakes assessment testing is examined in terms of both its relationship to test performance and the implications of low student effort for test validity. A theoretical model of test-taking motivation is presented, with a synthesis of previous research indicating that low student motivation is associated with a…

HRD evaluation models are recommended for use by organizations to improve decisions made about HRD interventions. However, the organizational decision-making literature has been virtually ignored by evaluation researchers. In this article, we review the organizational decision-making literature and critically review HRD evaluation research through…

The Non-Equivalent-groups Anchor Test (NEAT) design has been in wide use since at least the early 1940s. It involves two populations of test takers, P and Q, and makes use of an anchor test to link them. Two linking methods used for NEAT designs are those (a) based on chain equating and (b) that use the anchor test to post-stratify the…

This article updates and adds to the literature on graduate trainee impairment provided by L. Forrest, N. Elman, S. Gizara, and T. Vacha-Haase (1999) in their comprehensive literature review. Based on recommendations by Forrest et al., a program model for dealing with impaired trainees is proposed. The 5-step therapeutic process model includes (a)…

Objective:: This paper explores the characteristics associated with decisions to adopt or discontinue the use of filtering software, including a critical analysis of some explanations about why it is used or not used in households with children and adolescents. Method:: This study consisted of a national telephone survey of households in the…

This article focuses on the use of statistics in policy and evaluation research and the need to present statistical information in a form that is meaningful to mixed audiences. Three guidelines for formulating and presenting meaningful statistics are outlined. Understandability ensures that knowledge of statistical methods is not required for…

The lexically based Five-Factor Personality Inventory (FFPI) was correlated with the factors and facets of the Revised NEO Personality Inventory (NEO-PI-R) in Belgian (N = 265), American (N = 116), and Hungarian (N = 320) samples. Results were similar across the three cultures. Analysis of orthogonalized FFPI factors showed that three of…

We consider the question of how variation in the number and reliability of indicators affects the power to reject the hypothesis that the regression coefficients are zero in latent linear regression analysis. We show that power remains constant as long as the coefficient of determination remains unchanged. Any increase in the number of indicators…

This article describes a technique to analyze randomized response data using available structural equation modeling (SEM) software. The randomized response technique was developed to obtain estimates that are more valid when studying sensitive topics. The basic feature of all randomized response methods is that the data are deliberately…

This paper reports on a longitudinal study that examines how a national reform introduced in England in the field of adult literacy, language, and numeracy is affecting teachers. The paper focuses on the use of a mixed methodology to explore teachers' attitudes to the reform and how these change over time. The quantitative strand includes the…

There is a strong tendency for evidence-based approaches to social practices to view these practices as imperfect devices for delivering social services. Practices are regarded as in need of repair by evaluation (and research) that can deliver the necessary science-based solution to the problems of practice. This article presents a different view…

For many years, the European evaluation community did not recognize evaluation standards as a relevant tool for quality assurance. References to the developments in the United States were exceptionally rare in the European evaluation literature during the 1970s and 1980s. One of the first articles on evaluation standards to appear in the European…