The use of measures of magnitude of effect has been advocated as a way to go beyond statistical tests of significance and to identify effects of a practical size. They have been used in meta-analysis to combine results of different studies. Describes problems associated with measures of magnitude of effect (particularly study size) and…

In the social sciences, evaluating the effectiveness of a program or intervention often leads researchers to draw causal inferences from observational research designs. Bias in estimated causal effects becomes an obvious problem in such settings. This paper presents the Heckman Model as an approach sometimes applied to observational data for the…

Several recent studies have investigated the application of statistical inference procedures to the analysis of differential item functioning (DIF) in test items that are scored on an ordinal scale. Mantel's extension of the Mantel-Haenszel test is a possible hypothesis-testing method for this purpose. The development of descriptive statistics for…

Discussion of evaluation methodology in information retrieval focuses on the average precision over a set of fixed recall values in an effort to evaluate the retrieval effectiveness of a search algorithm. Highlights include a review of traditional evaluation methodology with examples; and a statistical inference methodology called bootstrap.…

Using the split-middle methods of trend estimation, evaluates the accuracy of interpretation of single subject data by comparing raters' visual analysis of behavior change with statistical determination of behavior change. Results indicate visual analysis accuracy was less than chance. Rater and student characteristics largely did not affect the…

College-educated adults (44 aged 18-22, 20 aged 30-49, and 20 aged 61-79) and adults with no college education (15 aged 62-68) were given the task of making deductive inferences in prose passages. There were no differences among college-educated adults, but the oldest college-educated group performed significantly better than those with no…

Two marble-and-ramp experiments investigated whether a simple-to-embedded-rules account can explain changes in children's causal reasoning. Results indicated that the same difference between three- and four-year olds in the prediction experiment appeared in the action experiment, suggesting that the same rules may underlie causal action as well as…

Compared the thinking of kindergartners and sixth-graders as expressed in unassisted retellings of a narrative text. Found no significant age differences in retelling lengths and few significant age differences in the amount of types of thinking. Older children tended to summarize paragraphs and single sentences; young children tended to summarize…

Results from two Monte Carlo studies in item response theory (comparisons of computer item analysis programs and Bayes estimation procedures) are analyzed with inferential methods to illustrate the procedures' strengths. It is recommended that researchers in item response theory use both descriptive and inferential methods to analyze Monte Carlo…

Two experiments examined the role of analogy in the development of a situation model of a target passage, specifically, whether an analogous source text could improve comprehension and inferencing about causal mechanisms in the target. Responses of analogy subjects were more likely to include given and inferred information that comprised the…

Studied the impact of changes in item difficulty on National Assessment of Educational Progress (NAEP) estimates over time through a Monte Carlo study that simulated the responses of 1990 NAEP mathematics respondents to 1990 and 1996 NAEP mathematics items. Results support the idea that these changes have not affected the NAEP trend line.…

Forty third graders divided into average and below average reading skill groups were given a story comprehension task that consisted of two conditions, listen through and think aloud. Average readers generated significantly more explanatory inferences and comprehension performance as measured by story recall was significantly better for both…

Devised is a test involving chemical examples to establish to what extent college chemistry students recognized and assessed the explanatory content of statements presented in the form of justifications. Several results are discussed. Several test items are included. (Author/YP)

Uses proverbs to facilitate the development of inferential reading skills. Provides examples of proverbs which children have finished with their own original endings. (MG)

Examines the influence of pre-reading instruction versus prior experience on factual and inferential comprehension. Concludes that prior experience affects factual and inferential comprehension more than does pre-reading instruction, and that younger students need to have relevant knowledge externally activated, while older students can activate…