BASIE is a framework for interpreting impact estimates from evaluations. It is an alternative to null hypothesis significance testing. This guide walks researchers through the key steps of applying BASIE, including selecting prior evidence, reporting impact estimates, interpreting impact estimates, and conducting sensitivity analyses. The guide…

The normal-distribution-based likelihood ratio statistic T[subscript ml] = nF[subscript ml] is widely used for power analysis in structural Equation modeling (SEM). In such an analysis, power and sample size are computed by assuming that T[subscript ml] follows a central chi-square distribution under H[subscript 0] and a noncentral chi-square…

Standard approaches for estimating item response theory (IRT) model parameters generally work under the assumption that the latent trait being measured by a set of items follows the normal distribution. Estimation of IRT parameters in the presence of nonnormal latent traits has been shown to generate biased person and item parameter estimates. A…

Whenever you think you have an idea of how something works, you have a mental model. That is, in effect, a layman's way of talking about having an hypothesis. The hypothesis needs to be tested for how closely it fits reality--and reality is the data collected from an experiment. So the data is collected on the few and compared with a few…

This paper draws upon a broader piece of research aimed at investigating assessment in higher education. It focuses upon the perceptions of undergraduates about issues of effectiveness, fairness and feedback, particularly in regard to the so-called learner-centred methods. In total, 378 undergraduate students participated in the study at the…

In light of the emergence of statistical analysis techniques based on data mining in education sciences, and the potential they offer to detect non-trivial information in large databases, this paper presents a procedure used to detect factors linked to academic achievement in large-scale assessments. The study is based on a non-experimental,…

A jack knife is a pocket knife that is put to many tasks, because it's ready to hand. Often there could be a better tool for the job, such as a screwdriver, a scraper, or a can-opener, but these are not usually pocket items. In statistical terms, the expression implies making do with what's available. Another simile, of an extreme situation, is…

We propose a new limited-information goodness of fit test statistic C[subscript 2] for ordinal IRT models. The construction of the new statistic lies formally between the M[subscript 2] statistic of Maydeu-Olivares and Joe (2006), which utilizes first and second order marginal probabilities, and the M*[subscript 2] statistic of Cai and Hansen…

The aim of this work is to develop and investigate the model for assessing learning management on the enrichment science classrooms in the upper secondary education of the Development and Promotion of Science and Technology Talents Project in Thailand. Using the research methodologies with the four phases: to investigate the background of the…

Value-added models have been widely used to assess the contributions of individual teachers and schools to students' academic growth based on longitudinal student achievement outcomes. There is concern, however, that ignoring the presence of missing values, which are common in longitudinal studies, can bias teachers' value-added scores.…

The authors identify 2 major types of statistical data from which semantic representations can be learned. These are denoted as "experiential data" and "distributional data". Experiential data are derived by way of experience with the physical world and comprise the sensory-motor data obtained through sense receptors. Distributional data, by…

This paper discusses the reliance of numerical analysis on the concept of the standard deviation, and its close relative the variance. It suggests that the original reasons why the standard deviation concept has permeated traditional statistics are no longer clearly valid, if they ever were. The absolute mean deviation, it is argued here, has many…

The European Credit Transfer and Accumulation System (ECTS) has been developed and instituted to facilitate student mobility and academic recognition. This paper presents, discusses, and illustrates the pertinence and the limitation of the current statistical distribution of the ECTS grades, and we propose an alternative way to calculate the ECTS…

A new item parameter replication method is proposed for assessing the statistical significance of the noncompensatory differential item functioning (NCDIF) index associated with the differential functioning of items and tests framework. In this new method, a cutoff score for each item is determined by obtaining a (1-alpha ) percentile rank score…

A procedure for the analysis of judgmental estimates is derived. It uses a t-distribution concept to derive the relative experience of an expert and uses the derived experience as weight to obtain a weighted mean. Using this method, error in estimation was reduced by an average of one-half. (Author/BW)