This research aims to compare the ability and item parameter estimations of Item Response Theory according to Maximum likelihood and Bayesian approaches in different Monte Carlo simulation conditions. For this purpose, depending on the changes in the priori distribution type, sample size, test length, and logistics model, the ability and item…

The mixed treatment comparison (MTC) method has been proposed to combine results across trials comparing several treatments. MTC allows coherent judgments on which of the treatments is the most effective. It produces estimates of the relative effects of each treatment compared with every other treatment by pooling direct and indirect evidence. In…

Network meta-analysis is a popular method to synthesize the information obtained in a systematic review of studies (e.g., randomized clinical trials) involving subsets of multiple treatments of interest. The dominant method of analysis employs within-study information on treatment contrasts and integrates this over a network of studies. One…

Comparative Judgement (CJ) aims to improve the quality of performance-based assessments by letting multiple assessors judge pairs of performances. CJ is generally associated with high levels of reliability, but there is also a large variation in reliability between assessments. This study investigates which assessment characteristics influence the…

We compared the Wechsler scores of individuals with twice-exceptionality (2e) and giftedness using a three-level Bayesian meta-analysis. Ninety-five effect sizes were calculated from 15 studies (n = 2,106). Results show that individuals with 2e who have learning disabilities perform lower than individuals with giftedness in Full-Scale Intelligence…

The evaluation of hypotheses, and the ability to learn from critical reflection on experimental and theoretical tests of those hypotheses, is central to an authentic practice of physics. A large part of physics education therefore seeks to help students understand the significance of this kind of reflective practice and to develop the strategies…

Researchers may have multiple motivations for combining disparate pieces of evidence in a meta-analysis, such as generalizing experimental results or increasing the power to detect an effect that a single study is not able to detect. However, while in meta-analysis, the main question may be simple, the structure of evidence available to answer it…

This study replicates and extends a 2004 content analysis of three major higher education journals. The original study examined the methodological characteristics of all published research in these journals from 1996 to 2000, recommending that higher education programs adjust their graduate training to better match the heavily quantitative and…

There are currently three main approaches to parameter estimation in item response theory (IRT): (1) joint maximum likelihood, exemplified by LOGIST, yielding maximum likelihood estimates; (2) marginal maximum likelihood, exemplified by BILOG, yielding maximum likelihood estimates of item parameters (ability parameters can be estimated…

I. Klugkist, O. Laudy, and H. Hoijtink (2005) presented a Bayesian approach to analysis of variance models with inequality constraints. Constraints may play 2 distinct roles in data analysis. They may represent prior information that allows more precise inferences regarding parameter values, or they may describe a theory to be judged against the…

A short review of the different estimation procedures that have been used in association with the Rasch model is provided. These procedures include joint, conditional, and marginal maximum likelihood methods; Bayesian methods; minimum chi-square methods; and paired comparison estimation. A comparison of the marginal maximum likelihood estimation…

Despite advances in common factor analysis, a review of 89 studies published in four selected journals between 1963 and 1976 indicated that behavioral scientists preferred principal components analysis, followed by varimax or orthogonal rotation. Resultant row sums of squares of factor matrices from principal component analyses of real data sets…

This paper reviews the literature about item response models for the subject level and aggregated level (group level). Group-level item response models (IRMs) are used in the United States in large-scale assessment programs such as the National Assessment of Educational Progress and the California Assessment Program. In the Netherlands, these…