Instructional strategies employing complex problem-solving examine how learners represent the problem space and argue for decisions. Unlike problems with few solutions (e.g., multiple choices), instructors struggle to evaluate solutions to ill-structured problems quickly and consistently across students. This prevents instructors to provide timely…

We describe a combination of methods for assessing the effectiveness of complex interventions, especially where substantial heterogeneity with regard to the population, intervention, comparison, outcomes, and study design of interest is expected. We applied these methods in a recent systematic review of the effectiveness of reinforced home-based…

This paper aims to illustrate how data visualization could be utilized to identify errors prior to modeling, using an example with multi-dimensional item response theory (MIRT). MIRT combines item response theory and factor analysis to identify a psychometric model that investigates two or more latent traits. While it may seem convenient to…

Delivering high-quality instruction grounded in evidence-based practices is one of the most important responsibilities of special education teachers. However, simply implementing effective evidence-based practices is not enough to ensure positive results; the practices must be implemented with fidelity (Cook & Odom, 2013). Although there are…

Risky sexual behaviors are behaviors that involve the possibility of an adverse outcome, such as contracting a sexually transmitted infection or unwanted pregnancy. The question of whether risky sexual behavior exists as a discrete class (i.e., taxon) or as a dimensional construct has not previously been explored. The authors performed a set of…

This article discusses the role of assessment in a response-to-intervention model. Although assessment represents only 1 component in a response-to-intervention model, a well-articulated assessment system is critical in providing teachers with reliable data that are easily interpreted and used to make instructional decisions. Three components of…

A within-subjects group experimental design was used to test whether three manipulated characteristics of multiple baseline across participants (MBL-P) data showing at least a month delayed change in slope affected experts' inference of a functional relation and agreement on this judgment. Thirty-six experts completed a survey composed of 16 MBL-P…

Three multidimensional item response theory (IRT) models for testlet-based tests are described. In the bifactor model (Gibbons & Hedeker, 1992), each item measures a general dimension in addition to a testlet-specific dimension. The testlet model (Bradlow, Wainer, & Wang, 1999) is a bifactor model in which the loadings on the specific dimensions…

The effects of two types of two well-established microcomputer-based teaching methods were examined for their effect on teaching high school students kinetics. The use of data acquisition probeware and digital video analysis were studied for their impact on students' conceptions and ability to interpret graphical relationships to real world…

In this experiment, physical science students measured the mass of several soda cans, measured the mass and volume of water displaced when these cans were placed in water, and determined whether these cans sank or floated in water. Then, the students plotted graphs of the mass of displaced water versus the volume of displaced water, the mass of…

The purpose of this study is to determine the extent of scale drift on a test that employs cut scores. It was essential to examine scale drift for this testing program because new forms in this testing program are often put on scale through a series of intermediate equatings (known as equating chains). This process may cause equating error to…

When conducting an exploratory factor analysis, the decision regarding the number of factors to retain following factor extraction is one that the researcher should consider very carefully, as the decision can have a dramatic effect on results. Although there are numerous strategies that can and should be utilized when making this decision,…

In Ramsay-curve item response theory (RC-IRT), the latent variable distribution is estimated simultaneously with the item parameters of a unidimensional item response model using marginal maximum likelihood estimation. This study evaluates RC-IRT for the three-parameter logistic (3PL) model with comparisons to the normal model and to the empirical…

Effects of response guided experimentation in applied behavior analysis on Type I error rates are explored. Data from T. A. Matyas and K. M. Greenwood (1990) suggest that, when visual inspection is combined with response guided experimentation, Type I error rates can be as high as 25%. (SLD)

The reliability of visual inspection in single-case research was investigated by determining agreement among 5 judges visually inspecting 44 graphs depicting behavior from baseline to intervention. Agreement between visual inspection and statistical procedures was determined. Implications for single-case research are discussed. (SLD)