Methodological and ethical challenges that researchers face when they conduct research with children are the focus of this article. The discussion is based on a study conducted with 2-6-year-old children in Iceland, where the purpose was to shed light on children's perspectives on their early childhood settings. The study is built on the…

Online professional development is multidimensional. It encompasses: a) an online, web-based format; b) professional development; and most likely c) specific objectives tailored to and created for the respective online professional development course. Evaluating online professional development is therefore also multidimensional and as such both…

A study examined the extent to which parents and adolescents participating in the Treatment for Adolescents With Depression Study (TADS) understood the study. The results concluded that most were well-informed, and also parents were overall better informed than adolescents.

Should the Russians be included in the evaluation and, if so, how can that be done? Based on the axiological assumption that the social justice theory of ethics leads to an awareness of the need to redress inequalities by giving precedence, or at least equal weight, to the voice of the least advantaged groups in society who may not have sufficient…

Previous studies of the validity of gains on high-stakes tests have compared trends in scores on a high-stakes test to trends on a lower-stakes test, such as NAEP. However, generalizability of gains is likely to be incomplete even when gains are meaningful because of differences in the inferences the two tests are designed to support. Therefore,…

Provides a practitioner's overview of the processes, models, and lessons learned from a successful application of Level Three training evaluation theory, tools, and principles. Focuses on the development and implementation of a program for a fast track, cost-effective evaluation that balances organizational needs, regulatory requirements, and…

Presents an alternative to measuring student overall satisfaction that uses, rather than a simple "yes/no" question, a multiple-item weighted gap score analysis approach. Results suggest that this approach may have more diagnostic value to both academics and practitioners. (EV)

Application of evaluability assessment by the Cooperative Extension Service of the Department of Agriculture is reviewed. The effort involved five states with six major programs since 1984. Underlying philosophy and methodological considerations are discussed, and background information is provided on the assessment processes and studies…

With the advent of program theory, evaluators have begun advancing understanding of how programs function in a specific context and how generalizations of program effects are contingent upon organizational, community, and cultural settings. Program theory is described and evaluated for practicality, and a congruent theory of program evaluation is…

Two competing approaches to policy analysis are distinguished: a credibility approach, and a truth approach. According to the credibility approach, the policy analyst's role is to search for plausible argument rather than truth. Each approach has pragmatic tradeoffs in fulfilling the goal of providing usable knowledge to decision makers. (TJH)

Examines the evolution of the test and measurement field and the growing edumetric trend as it relates to counselors' skill level. Discusses three competencies that counselors must use for adult assessments at personal and career intake: training in good test-use practices, awareness of the shift in education from psychometric to edumetric models,…

Compared a standard multiple choice exam format with two modified formats which provide instructors with information on students' risk preferences (students answer questions twice) and confidence in their answers (students assign a point value to questions). Found that while the alternatives offer increased choice to students and low-cost…

Outlines a procedure which training professionals and business managers can use to assess the effectiveness of their corporate evaluation studies. Meta-evaluation is explained; and phases in the training evaluation process, including plan, develop, obtain, analyze, and report, are described based on experiences at Motorola. (Contains two…

Describes and critiques medical school rankings by "U.S. News & World Report" on methodologic and conceptual grounds, arguing that the annual evaluation falls short in both areas. Presents three alternative categories of program quality indicators. Concludes that the rankings have no practical value and fail to meet standards of…

In evaluating family preservation services, it is important not only to study the service outcomes and the family characteristics, but also what actually happens during the treatment. This requires a program model. This article describes how a program model works, prescribes how workers should carry it out, and describes how researchers should…