To date, small sample problems with latent growth models (LGMs) have not received the amount of attention in the literature as related mixed-effect models (MEMs). Although many models can be interchangeably framed as a LGM or a MEM, LGMs uniquely provide criteria to assess global data-model fit. However, previous studies have demonstrated poor…

When subscores on a test are reported to the test taker, the appropriateness of reporting them depends on whether they provide useful information above what is provided by the total score. Subscores that fail to do so lack adequate psychometric quality and should not be reported. There are several methods for examining the quality of subscores,…

We discuss the learning goals, content, and delivery of a University of Plymouth intensive module delivered over four weeks entitled MATH1608PP Understanding Big Data from Social Networks, aimed at introducing students to a broad range of techniques used in modern Data Science. This module made use of R, accessed through RStudio, and some popular…

Open book assessment is not a new idea, but it does not seem to have gained ground in higher education. In particular, not much literature is available on open book examinations in mathematics and statistics in higher education. The objective of this paper is to investigate the appropriateness of open book assessments in a first-year business…

Using statewide longitudinal teacher survey data collected in 2009 and 2010, this study examined the characteristics of teacher evaluation used to determine performance-related pay (PRP), and the association between PRP and improvement in the practice of constructivist instruction. The study found that 10.9% of middle school mathematics teachers…

Background/Context: Principles of evidential reasoning have often been discussed in the context of educational and psychological measurement with respect to construct validity and validity arguments. More recently, Mislevy proposed the metaphor of assessment as an evidentiary argument about students' learning and abilities given their…

A jack knife is a pocket knife that is put to many tasks, because it's ready to hand. Often there could be a better tool for the job, such as a screwdriver, a scraper, or a can-opener, but these are not usually pocket items. In statistical terms, the expression implies making do with what's available. Another simile, of an extreme situation, is…

Statistics courses for prospective teachers are being developed in response to recent K-12 curriculum recommendations. As these courses are developed, it is important to design accompanying assessments. This manuscript describes a strategy for assessing aspects of statistical knowledge for teaching. The strategy involves analyzing and responding…

This paper looks at the role of "statistics-based knowledge" in the making of EU policy. We highlight "shortcomings" in the use of statistical indicators made in the course of the Lisbon strategy, ended in 2010. In our opinion the shortcomings are: (i) The paradox of the "coexistence" within the same European…

Maxwell, Cole, and Mitchell (2011) demonstrated that simple structural equation models, when used with cross-sectional data, generally produce biased estimates of meditated effects. I extend those results by showing how simple structural equation models can produce biased estimates of meditated effects when used even with longitudinal data. Even…

Heteronormativity, the concept that heterosexual sexuality is an institutionalized norm and a superior and privileged standard, is held firm when discourses of gender, sexualities and family form converge. In a study of heteronormative discourses in the context of early childhood education, teachers shared accounts of practices where genders,…

We propose a coefficient of agreement to assess the degree of concordance between two independent groups of raters classifying items on a nominal scale. This coefficient, defined on a population-based model, extends the classical Cohen's kappa coefficient for quantifying agreement between two raters. Weighted and intraclass versions of the…

The New York Performance Standards Consortium includes urban public high schools that have successfully used a performance-based assessment option. Instead of exit exams, student assessments are based on specific performance-based assessment tasks. These schools have shown that it is possible to use qualitative data to make substantive decisions…

How many students repeat a grade each year? How do retention rates vary across states and over time? Despite extensive research on the predictors and consequences of grade retention, there is no systematic way to quantify state-level retention rates; even national estimates rely on imperfect proxy measures. We present a conceptually simple…

Equating functions are supposed to be population invariant, meaning that the choice of subpopulation used to compute the equating function should not matter. The extent to which equating functions are population invariant is typically assessed in terms of practical difference criteria that do not account for equating functions' sampling…