Construct validity has been an issue in assessment centers literature. This study developed a model for competency-based assessment centers by integrating competency modeling, training design, assessment centers, and multi-source feedback assessment. Several propositions in conjunction with the model were also developed to help resolve construct…

This handbook brings together contributions by scholars in the areas of psychometrics, assessment, and evaluation who have expertise in the application of testing and assessment in multicultural environments. The book provides a comprehensive view of various cultural issues and offers updated information pertaining to the usage of major…

The Even Start program, designed to demonstrate ways of implementing and delivering family literacy services, has had strong evaluation requirements since its inception. An analysis was conducted to determine the types of evaluations programs had conducted and their findings concerning Even Start outcomes. A convenience sample of 4 state…

Linked with professional development programs to support the implementation of Te Whariki, the national early childhood curriculum in New Zealand, a project was designed to: (1) construct a framework for assessment and evaluation in early childhood programs in Aotearoe-New Zealand; and (2) use this framework to develop an evaluation process…

Innovations in educational organizations have not received the same attention as those in business organizations. To flourish at a school-organization level, and be replicated in other institutions, the mechanisms that sustain and encourage innovations must be understood clearly. A study examined innovations adopted at four schools to uncover the…

Washback or backwash, also known as measurement-driven instruction, is a common term in applied linguistics referring to the influence of testing on teaching and learning, which is a prevailing phenomena in education. It is a truism that "what is assessed becomes what is valued, which becomes what is taught." This paper aims to share the…

This paper shows how the concept of general objectivity can be used to improve behavioral science measurement, particularly as it applies to the Lexile Framework, a tool for objectively measuring reading comprehension. It begins with a dialogue between a physicist and a psychometrician that details some of the differences between physical science…

Describes a small-scale study of newly enrolled Open University (Great Britain) students regarding their views of nontraditional strategies for assessment and for maximizing openness through the use of questionnaires and interviews. Topics include self-assessment; peer assessment; fixed deadlines for course assignments; independent thinking; and…

Discussion of portfolios as authentic assessment measures focuses on a review of schools requiring portfolios for Master of Library Science programs that identified commonalities among programs. Analyzed documents at Web sites to determine that at least 14 ALA-accredited programs use portfolio assessment for evaluation of student performance,…

Reviews evidence for the effectiveness of electronic surveys as evaluation methods for electronic courses and discusses issues in email and Web survey methodologies. Describes the successful use of Web-based surveys in the evaluation system of the University of Sydney Medical Program and includes recommendations for online survey use in course…

Describes a study that seeks to confirm several key factors in computer-based versus paper-based assessment. Based on earlier research, the factors considered in this study of undergraduates include content familiarity; computer familiarity; competitiveness; and gender. Reports results of analysis of variance that showed the computer-based test…

Presents a theoretical discussion of evaluation research and the need for gathering data to support the decision-making process concerned with training program performance. Guidelines for conducting evaluation research are discussed, the participants involved with successful implementation are described, and data gathering methods are explained.…

Evaluation research, if appropriately matched to a human service program's stage of development, can help inform the decision making at each step. The developmental stages of a program, questions to be answered at each stage, and kinds of research activities pertinent to such questions are discussed. (TJH)

Reports findings of studies investigating the influence of default values (i.e., excellent, good, or poor) on the evaluative behavior of students completing computerized instruments for rating instruction. Respondents who were exposed to the excellent default rated the instructor more favorably. Order and contiguity of items did not influence…

Utilizes an applicability paradigm to test the validity of the Students' Evaluation of Educational Quality (SEEQ) and the Endeavor questionnaire across seven countries. The similarity of results supported the instruments' applicability as measures of teacher effectiveness across different countries. Includes six tables of statistical data. (MJP)