This report provides advice to policymakers and school leaders on the use of assessment centres as part of a teacher selection approach. It discusses the relationship between assessment centre scores prior to joining teaching, and teacher effectiveness over a six-year period. It draws from various stages of a wider research project, the overall…

In this digital ITEMS module, Dr. Brian Leventhal and Dr. Allison Ames provide an overview of "Monte Carlo simulation studies" (MCSS) in "item response theory" (IRT). MCSS are utilized for a variety of reasons, one of the most compelling being that they can be used when analytic solutions are impractical or nonexistent because…

A compositional effect is when pupil attainment is associated with the characteristics of their peers, over and above their own individual characteristics. Pupils at academically selective schools, for example, tend to out-perform similar-ability pupils who are educated with mixed-ability peers. Previous methodological studies however have shown…

In this article, we propose the concept of "Autonomic Cycle Of Learning Analysis Tasks" (ACOLAT), which defines a set of tasks of learning analysis, whose objective is to improve the learning process. The data analysis has become a fundamental area for the knowledge discovery from data extracted from different sources. In the autonomic…

Reliabilities of the two most widely used intraindividual variability indicators, "ISD[superscript 2]" and "ISD", are derived analytically. Both are functions of the sizes of the first and second moments of true intraindividual variability, the size of the measurement error variance, and the number of assessments within a burst. For comparison,…

It has been known for some time that item response theory (IRT) models may exhibit a likelihood function of a respondent's ability which may have multiple modes, flat modes, or both. These conditions, often associated with guessing of multiple-choice (MC) questions, can introduce uncertainty and bias to ability estimation by maximum likelihood…

Mediation is usually assessed by a regression-based or structural equation modeling (SEM) approach that we refer to as the classical approach. This approach relies on the assumption that there are no confounders that influence both the mediator, "M", and the outcome, "Y". This assumption holds if individuals are randomly…

There are many definitions that are attributable to the meaning of sustainability. Sustainability can be viewed as long-lasting, effective result of a project, venture, action, or investment without consuming additional future resources. Because of the wide nature of its applicability, a universal measure of sustainability is hard to come by. This…

For RCTs of education interventions, it is often of interest to estimate associations between student and mediating teacher practice outcomes, to examine the extent to which the study's conceptual model is supported by the data, and to identify specific mediators that are most associated with student learning. This article develops statistical…

A variance-to-range ratio variable weighting procedure is proposed. We show how this weighting method is theoretically grounded in the inherent variability found in data exhibiting cluster structure. In addition, a variable selection procedure is proposed to operate in conjunction with the variable weighting technique. The performances of these…

In this paper, we describe an approach to analyze 2D truss/Frame/Beam structures under Flash-based environment. Stiffness Matrix Method (SMM) module was developed as part of ongoing projects on a broad topic "Students' Learning Improvements in Science, Technology, Engineering and Mathematics (STEM) Related Areas" at Old Dominion…

This article introduces a multinomial error model, which models an examinee's test scores obtained over repeated measurements of an assessment that consists of polytomously scored items. A compound multinomial error model is also introduced for situations in which items are stratified according to content categories and/or prespecified numbers of…

Bayesian inference on multinomial probabilities is conducted based on data collected from the game Pass the Pigs[R]. Prior information on these probabilities is readily available from the instruction manual, and is easily incorporated in a Dirichlet prior. Posterior analysis of the scoring probabilities quantifies the discrepancy between empirical…

This paper discusses two topics related to diagnostic score reporting for credentialing examinations. The first deals with various ways to compute subscores for credentialing examinations. The second addresses some pertinent factors to consider when presenting diagnostic results. To illustrate these issues, a sample set of subscores is used. This…

Describes four procedures previously developed for estimating conditional standard errors of measurement for scale scores and compares them in a simulation study. All four procedures appear viable. Recommends that test users select a procedure based on various factors such as the type of scale score of concern, test characteristics, assumptions…