We first review existing literature on cumulative logit models along with various ways to test the parallel lines assumption. Building on the traditional frequentist framework, we introduce a method of Bayesian assessment of null values to provide an alternative way to examine the parallel lines assumption using highest density intervals and…

There is increased use of Bayesian networks (BN) in educational assessment. In psychometrics, BN serves as a measurement model with high flexibility, suitable to model educational assessment data with a complex structure. BN is a novel psychometric approach and not all aspects of its application are well-known. The article aims to provide the…

The mixed treatment comparison (MTC) method has been proposed to combine results across trials comparing several treatments. MTC allows coherent judgments on which of the treatments is the most effective. It produces estimates of the relative effects of each treatment compared with every other treatment by pooling direct and indirect evidence. In…

The performance of statistical methods is often evaluated by means of simulation studies. In case of network meta-analysis of binary data, however, simulations are not currently available for many practically relevant settings. We perform a simulation study for sparse networks of trials under between-trial heterogeneity and including multi-arm…

Comparative Judgement (CJ) aims to improve the quality of performance-based assessments by letting multiple assessors judge pairs of performances. CJ is generally associated with high levels of reliability, but there is also a large variation in reliability between assessments. This study investigates which assessment characteristics influence the…

Meta-analyses of clinical trials targeting rare events face particular challenges when the data lack adequate numbers of events for all treatment arms. Especially when the number of studies is low, standard random-effects meta-analysis methods can lead to serious distortions because of such data sparsity. To overcome this, we suggest the use of…

The theoretical rationales and procedures of five adaptive computer-based instruction models were reviewed: the mathematical model, the regression model, the Bayesian probabilistic model, the testing and branching model, and artificially intelligent instructional systems. Each model is assessed for contrast of methods and forms, identifiable…

Experimental data on human reasoning in hypothesis-testing tasks is reassessed in light of a Bayesian model of optimal data selection in inductive hypothesis testing. The rational analysis provided by the model suggests that reasoning in such tasks may be rational rather than subject to systematic bias. (SLD)

This article explores the potential of Bayesian inference as a theoretical framework for describing how people evaluate hypotheses. First, it identifies a set of logically possible forms of non-Bayesian behavior. Second, it reviews existing research in a variety of areas to see whether these possibilities are ever realized. (Author/BW)

There are currently three main approaches to parameter estimation in item response theory (IRT): (1) joint maximum likelihood, exemplified by LOGIST, yielding maximum likelihood estimates; (2) marginal maximum likelihood, exemplified by BILOG, yielding maximum likelihood estimates of item parameters (ability parameters can be estimated…

A short review of the different estimation procedures that have been used in association with the Rasch model is provided. These procedures include joint, conditional, and marginal maximum likelihood methods; Bayesian methods; minimum chi-square methods; and paired comparison estimation. A comparison of the marginal maximum likelihood estimation…

Presents a method of modeling the relevance relationship in information retrieval to answer the question of the theoretical limits of certain statistical methods. Hypergeometric probability distribution is used to construct an abstract model of a database of MEDLINE records, and results of tests of vector retrieval methods are reported. (28…

Despite advances in common factor analysis, a review of 89 studies published in four selected journals between 1963 and 1976 indicated that behavioral scientists preferred principal components analysis, followed by varimax or orthogonal rotation. Resultant row sums of squares of factor matrices from principal component analyses of real data sets…

An empirical review of test items is described as an essential step in criterion-referenced test development. The concept of test items' instructional sensitivity is introduced, and research is briefly reviewed which describes four theoretical contexts in which instructional sensitivity indexes have been observed: criterion-referenced; classical…

Topics concerning latent trait theory are addressed: (1) dimensionality of latent space, local independence, and item characteristic curves; (2) models--equations, parameter estimation, testing assumptions, and goodness of fit, (3) applications test developments, item bias, tailored testing and equating; and (4) advantages over classical…