By tailoring test forms to the test-taker's proficiency, Computerized Adaptive Testing (CAT) enables substantial increases in testing efficiency over fixed forms testing. When used for formative assessment, the alignment of task difficulty with proficiency increases the chance that teachers can derive useful feedback from assessment data. The…

A pretest-posttest control group design with switching replications was used to examine the effectiveness of a one-time, 75-minute behavioral skills training (BST) package. Fifty pre-service elementary general educators enrolled in a classroom management course were shown a video depicting challenging behaviors and were asked to collect…

Setting variables such as location of parent training, programming with common stimuli, generalization of discrete responses to non-trained settings, and subsequent reduction in child problem behavior may influence the effectiveness of interventions. The purpose of this study was to evaluate the effectiveness of home-versus clinic-based training…

The assessment of the number of dimensions and the dimensionality structure of questionnaire data is important in scale evaluation. In this study, the authors evaluate two dimensionality assessment procedures in the context of Mokken scale analysis (MSA), using a so-called fixed lowerbound. The comparative simulation study, covering various…

The goal of the dependability analysis is to predict inconsistencies and to reveal ambiguities and incompleteness in the designed learning scenario. Evaluation, in traditional learning design, is generally planned after the execution of the scenario. In mobile learning, this stage becomes too difficult and expensive to apply due to the complexity…

Using exogenous characteristics to identify endogenous subgroups, the approach discussed in this method note creates symmetric subsets within treatment and control groups, allowing the analysis to take advantage of an experimental design. In order to maintain treatment--control symmetry, however, prior work has posited that it is necessary to use…

This study applies the learning curve method of measuring learning to participants of a computer-assisted business gaming simulation that includes a multiple-life-cycle feature. The study involved 249 participants. It verified the workability of the feature and estimated the participants' rate of learning at 17.4% for every doubling of experience.…

This dissertation comprises three papers that propose, discuss, and illustrate models to make improved inferences about research questions regarding student achievement in education. Addressing the types of questions common in educational research today requires three different "extensions" to traditional educational assessment: (1)…

When estimating causal effects from observational data, it is desirable to approximate a randomized experiment as closely as possible. This goal can often be achieved by choosing a subsample from the original control group that matches the treatment group on the distribution of the observed covariates. However, sometimes the original control group…

In educational effectiveness research, multilevel data analyses are often used because research units (most frequently, pupils or teachers) are studied that are nested in groups (schools and classes). This hierarchical data structure complicates designing the study because the structure has to be taken into account when approximating the accuracy…

The paper gives an overview of multidimensional adaptive testing (MAT) and evaluates its applicability in educational and psychological testing. The approach of Segall (1996) is described as a general framework for MAT. The main advantage of MAT is its capability to increase measurement efficiency. In simulation studies conceptualizing situations…

Cluster randomized trials (CRTs) have been widely used in field experiments treating a cluster of individuals as the unit of randomization. This study focused particularly on situations where CRTs are accompanied by a common complication, namely, treatment noncompliance or, more generally, intervention nonadherence. In CRTs, compliance may be…

The development of A Simulation in Educational Evaluation (SIMEDEVAL), a simulation designed to increase the evaluation capability of school personnel is described. The Discrepancy Evaluation Model served as the simulation model and the framework for field test procedure. Instruments were constructed and validated for use in the field test with…

To identify management development needs some organizations have adopted the assessment center method, using simulations of work situations performed before and evaluated by specially trained observers (assessors). (MF)

This is a critical review of the analytical models developed by the U.S. Army to predict training device effectiveness. The Simulation Systems Technical Area of the U.S. Army Research Institute for the Behavioral and Social Sciences performed the research. Special consideration is given to a family of models known collectively as TRAINVICE. These…