Component network meta-analysis (CNMA) compares treatments comprising multiple components and estimates the effects of individual components. For network meta-analysis, a standard network plot with nodes for treatments and edges for direct comparisons between treatments is drawn to visualize the evidence structure and the connections between…

This study aims to compare normality tests in different sample sizes in data with normal distribution under different kurtosis and skewness coefficients obtained simulatively. To this end, firstly, simulative data were produced using the MATLAB program for different skewness/kurtosis coefficients and different sample sizes. The normality analysis…

As a research field geared toward understanding and improving learning, Learning Analytics (LA) must be able to provide empirical support for causal claims. However, as a highly applied field, tightly controlled randomized experiments are not always feasible nor desirable. Instead, researchers often rely on observational data, based on which they…

We describe a combination of methods for assessing the effectiveness of complex interventions, especially where substantial heterogeneity with regard to the population, intervention, comparison, outcomes, and study design of interest is expected. We applied these methods in a recent systematic review of the effectiveness of reinforced home-based…

It is common practice for assessment programs to organize qualifying sessions during which the raters (often known as "markers" or "judges") demonstrate their consistency before operational rating commences. Because of the high-stakes nature of many rating activities, the research community tends to continuously explore new…

We present a new system for automated scoring of graph construction items that address complex science concepts, feature qualitative prompts, and support a range of possible solutions. This system utilizes analysis of spatial features (e.g., slope of a line) to evaluate potential student ideas represented within graphs. Student ideas are then…

Patients with traumatic brain injury show clear impairments in behavioural flexibility and inhibition that often persist beyond the time of injury, affecting independent living and psychosocial functioning. Functional magnetic resonance imaging studies have shown that patients with traumatic brain injury typically show increased and more broadly…

Three multidimensional item response theory (IRT) models for testlet-based tests are described. In the bifactor model (Gibbons & Hedeker, 1992), each item measures a general dimension in addition to a testlet-specific dimension. The testlet model (Bradlow, Wainer, & Wang, 1999) is a bifactor model in which the loadings on the specific dimensions…

In this experiment, physical science students measured the mass of several soda cans, measured the mass and volume of water displaced when these cans were placed in water, and determined whether these cans sank or floated in water. Then, the students plotted graphs of the mass of displaced water versus the volume of displaced water, the mass of…

The present study investigated the extent to which providing students with individualized performance feedback informed and directed their learning behavior. Individualized performance feedback was delivered to students using curriculum-based measurement progress indicators, either as a visual representation of ongoing performance in the form of a…

Describes and compares three approaches to task analysis--behaviorally-based, concept-based, and cognitive process-based--and provides four tentative recommendations for determining which approach is appropriate in a particular situation. Five flowcharts and fourteen references are included. (MBR)

It is argued that there is a benefit to applying techniques of exploratory data analysis (EDA) to program evaluation. The evaluation of a rehabilitation program for people with rheumatoid arthritis (20 subjects and 21 comparisons) through EDA supports the argument, indicating outcomes more precisely than conventional analysis of variance. (SLD)

Compares compact discs (CD-ROMs) and online services in terms of cost of information delivery; system advantages and disadvantages; future possibilities; and role in the National Information Infrastructure. Analysis reveals that CD-ROMs have the lowest information delivery cost and are endorsed by the marketplace as a cost-effective way to deliver…

The results of a survey are reported in two parts: (1) the compilation of an annotated inventory of recurrent secondary services in education produced in the United Kingdom--abstracting, indexing, and current awareness services; and (2) detailed analyses of the important characteristics of timelag, coverage, physical format, and entry format in…

The effectiveness of using the age of references to control the exhaustivity of the reference representation in information retrieval was investigated through analysis of optimal cluster-based retrieval results. The results show that the foreground representation at its optimal level of exhaustivity is restricted to references with ages less than…