Meta-analytic reliability generalizations (RGs) are limited by the scarcity of reliability reporting in primary articles, and currently, RG investigators lack a method to quantify the impact of such nonreporting. This article introduces a stepwise procedure to address this challenge. First, the authors introduce a formula that allows researchers…

CSCL research has given rise to a plethora of analysis methods, all with specific analysis goals, units of analysis, and for specific types of data (chat, threaded discussions, etc.). This article describes some challenges of CSCL-analysis. The development of an analysis method for negotiation processes in multidisciplinary teams serves as an…

This study of the stability of parent behaviors toward toddlers over a 3-week period used both aggregated and nonaggregated data. Comparison of stability correlations indicated higher stabilities for aggregated scores, with the level of stability increasing as scores from additional single sessions were aggregated. (PCB)

Narrative data yield rich detail, insight, and information, but the personal and situational characteristics of coders (called value inertia and cognitive limitation biases) can affect data reduction. The effects of coder exposure to expected project outcomes and the level of coder research methodology sophistication were investigated. Coders,…

The study, with 79 rehabilitation therapists evaluating 21 single-subject graphs, found that the low interrater agreement often associated with visual analysis of single-subject data may be improved by simple supplements (such as trend lines) to visually inspected charts. (Author/DB)

The Correct Information Unity analysis for measuring the communicative information and efficiency of connected speech was applied to the naturally occurring conversation of a person with moderate aphasia. Results indicated low intrarater and interrater reliability although reliability of word counts was good. Most rater disagreements resulted from…

Because health behavior is often concerned with dynamic constructs, a longitudinal approach to measurement is needed. The Longitudinal Guttman Simplex (LGS) is a measurement model developed especially for dynamic constructs exhibiting cumulative, unitary development measured longitudinally. Data from the Television Smoking Prevention Project, a…

The focus of this study was on the visual analysis of time series data for evaluating educational programs. Two characteristics of the data--changes in slope and variability--and two characteristics of evaluation--training in data utilization and the use of aimlines/decision rules--were manipulated. A total of 51 students and/or teachers in…

The study of teachers as decision-makers is a recent paradigm in educational research. This decision-making approach considers the teacher as an active professional engaged in various decision-making activities prior to and during instruction. This paper describes a naturalistic research design employed in a recent dissertation that investigated…

This document investigates the widely used school climate assessment instrument, the CFK Ltd. School Climate Profile. Part A (General School Climate Factors) was administered by school to a junior high campus (n=257) and a high school campus (n=906) in a major metropolitan area in the Southwestern United States to gather data for administrative…

Addresses applications of the coefficient of variation as a measure of educational inequality or as a means of measuring changes of inequality status. Suggests the Gini coefficient has many advantages over the coefficient of variation since it can be used with the Lorenz curve (Lorenz provides detail Gini omits). (BRR)

The nine-volume Survey Kit is designed to help readers prepare and conduct surveys and become better users of survey results. All the books in the series contain instructional objectives, exercises and answers, examples of surveys in use, illustrations of survey questions, guidelines for action, checklists of "dos and don'ts," and…

This book offers a resource guide for qualitative researchers in education, discussing data collection techniques, data analysis, reporting, and the issues of validity, reliability, and ethics. Part 1 reviews the nature and design of qualitative research; it discusses various types of qualitative research (including case studies), and how to…

Cason and Cason's model of performance rating was used to determine the extent to which variation in reviewer standards affected the reliability and validity of the program review process used to select papers for inclusion in the annual program. Data analyzed were the overall recommendation for acceptance and ratings on seven quality criteria…

Research on reading teacher effectiveness has taken several different directions over the past 30 years: during the 1950s and most of the 1960s, research focused primarily on teacher qualities; in the early 1970s attention shifted to the effect of the teaching process on student learning, while in the late 1970s and early 1980s experiments defined…