Developing models and using mathematics are two key practices in internationally recognized science education standards such as the Next Generation Science Standards (NGSS, 2013). In this paper, we used a virtual performance-based formative assessment to capture students' competencies at both "developing" and "evaluating"…

In this paper, we present the development of an investigation on the promotion of covariational reasoning in high school students (14-15 years old) in Mexico. The study consists of designing and applying a sequence of didactic activities that simulate a real situation virtually. The activities are organized through a Hypothetical Learning…

Developing models and using mathematics are two key practices in internationally recognized science education standards, such as the Next Generation Science Standards (NGSS). However, students often struggle with these two intersecting practices, particularly when developing mathematical models about scientific phenomena. Formative…

Many national science frameworks (e.g., Next Generation Science Standards) argue that developing mathematical modeling competencies is critical for students' deep understanding of science. However, science teachers may be unprepared to assess these competencies. We are addressing this need by developing virtual lab performance assessments that…

We analyzed 5th grade students' interactions with one computer-based modeling simulation to examine how they defined and prioritized variables in a dynamically simulated environment. Results revealed that exposure to the simulation environment helped students visualize continuous motions, interpret the different quantities present in the model,…

Cross-validation, an economical method for assessing whether sample results will generalize, is discussed in this paper. Cross-validation is an invariance technique that uses two subsets of the data sample to derive discriminant function coefficients. The two sets of coefficients are then used with each data subset to derive discriminant function…

When normality does not hold, nonparametric tests represent an important data-analytic alternative to parametric tests. However, the use of nonparametric tests in educational research has been limited by the absence of easily performed tests for complex experimental designs and analyses, such as factorial designs and multiple regression analyses,…

This repeated measures factorial design study compared the results of two procedures for identifying multivariate outliers under varying conditions, the Mahalanobis distance and the Andrews-Pregibon statistic. Results were analyzed for the total number of outliers identified and number of false outliers identified. Simulated data were limited to…

A complete enumeration method and a Monte Carlo method are presented to calculate the probability distribution of arbitrary statistics of adjacency matrices when these matrices have the uniform distribution conditional on given row and column sums, and possibly on a given set of structural zeros. (SLD)

The challenge of multiple comparisons is to maximize the power for answering specific research questions, while still maintaining control over the rate of Type I error. Several multiple comparison procedures have been suggested to meet this challenge. The stagewise protected procedure (SPP) of A. J. Klockars and G. R. Hancock tests null hypotheses…

Using computer simulation data, the effect of a single global outlier in two-group classification analysis was explored in terms of the outcome variables of change in classification results (PCHNG), change in misclassification rate (MISDIF), and change in precision of misclassification rate estimation. The precision of misclassification rate…

Concern has been expressed over the item response theory (IRT) assumption that a person's ability can be estimated in a unidimensional latent space. To examine whether or not the response to an item requires only a single latent ability, unidimensional ability estimates were compared for data generated from the multidimensional item response…

Correlation coefficients are frequently reported in educational and psychological research. The robustness properties and optimality among practical approximations when phi does not equal 0 with moderate sample sizes are not well documented. Three major approximations and their variations are examined: (1) a normal approximation of Fisher's Z,…

An investigation of the effects of randomly missing data in two-predictor regression analyses is described. The differences in the effectiveness of five common treatments of missing data on estimates of R-squared values and each of the two standardized regression weights is also investigated. Bootstrap sample sizes of 50, 100, and 200 were drawn…

This study considers the problem of performing all pairwise comparisons of column means for a two-by-four additive nonorthogonal factorial analysis of variance (ANOVA) model where cell variances are heterogeneous. Extensions of the following procedures are considered: (1) Games-Howell (1976) procedure; (2) the C. W. Dunnett (1980) T3 and C…