Combining observational and experimental data for causal inference can improve treatment effect estimation. However, many observational data sets cannot be released due to data privacy considerations, so one researcher may not have access to both experimental and observational data. Nonetheless, a small amount of risk of disclosing sensitive…

The four-parameter logistic (4PL) Item Response Theory (IRT) model has recently been reconsidered in the literature due to the advances in the statistical modeling software and the recent developments in the estimation of the 4PL IRT model parameters. The current simulation study evaluated the performance of expectation-maximization (EM),…

Background: An efficacy study based on a randomized controlled trial (RCT) was designed to evaluate the impact of ASSISTments on math learning among middle school students, including those from high-needs rural schools. Despite extensive recruitment efforts in 2021 (during the pandemic), only a few schools and their teachers agreed to participate,…

This is a technical report detailing the analytic methods used to assess the effects of a virtual professional learning community (vPLC)-enhanced ASSISTments intervention. The report uses a quasi-experimental design and partially nested regression model to account for clustering and reveals that while overall effects were positive but not…

Describes a new effectiveness measure as an alternative to the traditional evaluation measures of recall and precision in information retrieval systems. The statistical approach--which compares two retrieval algorithms--is explained, the information needs of the user are considered, and an experiment with a test collection of abstracts is…

This paper presents a study on the generation of mathematics test items using algorithmic methods. The history of this approach is briefly reviewed and is followed by a survey of the research to date on the statistical parallelism of algorithmically generated mathematics items. Results are presented for 8 parallel test forms generated using 16…

This project examines anaphora (the linguistic device of abbreviated subsequent reference to a concept) in information retrieval (IR) systems in order to develop procedures to recognize anaphors in text and distinguish between anaphoric and non-anaphoric uses of a given term, estimate the number of anaphors appearing in bibliographic records, and…

A method for predicting freshman performance based on high school grades allows calculation of any student's likely grades in a similar university course. The method is contrasted with several more traditional predictive methods and examined in a study of 3,734 University of Western Australia students. (MSE)

This study of training needs utilized a questionnaire to assess participant's opinions of knowledge level that should exist and knowledge level that does exist in 25 content areas and analyzed the resultant data using three different approaches: mean difference analysis, multicomponent data analysis, and weighted need index. (MBR)

Describes the PADOK-II project in Germany, which was designed to give information on the effects of linguistic algorithms on retrieval in a full-text database, the German Patent Information System (GPI). Relevance assessments are discussed, statistical evaluations are described, and searches are compared for the full-text section versus the…

In machine learning there is considerable interest in techniques which improve planning ability. Initial investigations have identified a wide variety of techniques to address this issue. Progress has been hampered by the utility problem, a basic tradeoff between the benefit of learned knowledge and the cost to locate and apply relevant knowledge.…