Characteristics of new information technologies have implications for their evaluation. The instability of most technologies, and their novelty for most users, calls into question the value of experimental summative studies. Their interactive character challenges the traditional formative paradigm. Case studies and field experiments can help to…

If being a competent small group problem solver is difficult, it is even more difficult to impart those competencies to others. Unlike athletic coaches who are near their players during the real game, teachers of small group communication are not typically present for on-the-spot coaching when their students are doing their problem solving. That…

A new instrument was designed by S. Hord (1996) to assess globally the maturity of a school's professional staff as a learning community. The Appalachia Educational Laboratory agreed to field test this instrument to determine its reliability and validity and to draw conclusions about its use in educational improvement. The instrument consisted of…

The Continuous School Improvement Questionnaire (CSIQ) is a comprehensive inventory measuring educators' perceptions of factors that affect success with school improvement. A pilot test of the CSIQ was conducted in Spring 2000, one purpose of which was to reduce the length of the CSIQ. The instrument was reduced from 147 to 72 items. The pilot…

Describes a series of 12 books for use in high schools that cover aspects of women's lives in American society. The books are designed to counter the White male bias of the curriculum by exploring the history and culture of women. Field testing activities are described. (Author/RH)

The dominant profile judgment method, designed for use with profiles of polytomous scores on exercises in a performance-based assessment, is presented as a standard-setting method. The approach guides standard-setting panelists in articulating their standard-setting policies and allows for complex policy statements. (SLD)

This article describes efforts involved in an initial attempt to develop an objective instrument that assesses a teacher's perceived engagement in reflective practice. The Reflective Teaching Instrument was developed around three dimensions of reflective practice: diagnosis, testing, and personal causation. (IAH)

Describes research and evaluation on the Information Mapping method of structured analysis and writing of training and reference documents to illustrate how a flaw in research design can cause "little or no effect" results. Information retrieval experiments, learning experiments, and field tests are examined for problems, including size…

Discusses the portability of a Canadian-made educational simulation software package, "The Electronics Workbench," to China that was part of a larger study conducted at the University of Twente (The Netherlands). Evaluation results of the software use in China are presented, including functionality for electronics education, ease of use,…

The results of field-testing a substance-abuse treatment protocol are reported. Ten probation and parole officers were trained in Structured Relapse Prevention, and 55 clients were treated. Incentives and barriers to treatment are highlighted. The use of this type of field test as a dissemination technique is discussed. (EMK)

Research on teacher-child relationships, classroom environments, and teaching practices provided the rationale for constructing a system for observing and assessing emotional and instructional elements of quality in early childhood educational environments: the Classroom Assessment Scoring System (CLASS). The CLASS provides a framework for…

This article describes the development and field test of an instrument, the Views on Science and Education Questionnaire, designed to measure participants' concepts of the nature of science (NOS) and relevant teaching attitudes. The questionnaire includes 15 questions, each followed by several items representing different philosophical positions.…

NAEP (National Assessment of Education Progress) has developed its first set of assessment tasks for measuring student achievement in theatre. These tasks draw on a wide range of dramatic forms and use both paper-and-pencil and performance tasks. Sections in this serial issue include: "The Importance of Theatre"; "The Theatre…

The last decade has seen the emergence in the policy arena of a new form of qualitative research, one intended to strenghten its ability to generalize while preserving in-depth description. These multisite qualitative studies address the same research question using similar data collection and analysis procedures in a number of settings. To gain…

The goal of this project was to develop an inexpensive, self-contained system of hardware and software to support the development, administration, and evaluation of computerized adaptive tests. Toward that goal, commercial hardware was selected and a comprehensive software called the MicroCAT Testing System was developed. The MicroCAT system was…