Coefficient alpha reliability persists as the most common reliability coefficient reported in research. The assumptions for its use are, however, not well-understood. The current paper challenges the commonly used expressions of coefficient alpha and argues that while these expressions are correct when estimating reliability for summed scores,…

The multistage testing (MST) design has been gaining attention and popularity in educational assessments. For testing programs that have small test-taker samples, it is challenging to calibrate new items to replenish the item pool. In the current research, we used the item pools from an operational MST program to illustrate how research studies…

The present study examined whether scaling direction and perceptual modality affect children's spatial scaling. Children aged 6-8 years (N = 201) were assigned to a visual, visuo-haptic, and haptic condition in which they were presented with colourful, embossed graphics. In the haptic condition, they were asked to wear a blindfold during the test…

In vertical scaling, results of tests from several different grade levels are placed on a common scale. Most vertical scaling methodologies rely heavily on the assumption that the construct being measured is unidimensional. In many testing situations, however, such an assumption could be problematic. For instance, the construct measured at one…

We developed and validated scores on the Lifestyle Practices and Health Consciousness Inventory (LPHCI)-2: Brief Version, a short form for measuring global wellness (mental and physical health). Tests of internal structure (EFA, CFA, and higher-order CFA) as well as convergent validity supported the psychometric properties of LPHCI-2: Brief…

The general expectation for many successful educational innovations is to "scale up" the project. Based on interviews with participating teachers, facilitators and administrators, this research shares findings from the "scaling up" stage of a federally funded mathematics project designed to help teachers reach a wide range of…

Single-case design is a research methodology that entails repeated measurement to assess the influence of an independent variable on a dependent variable over time. Data collected in this manner are regularly analyzed using visual analysis of data displayed in a linear graph. Although there is agreement regarding critical elements of visual…

Solution-focused (SF) approaches are widely used in schools. The present study examined the effects of a central SF technique--"scaling"--on female secondary students' improvement expectancy (IE) and commitment to improvement (CTI). Popular follow-up questions were also tested. In Experiment 1, 120 students were randomly assigned to a…

Single-case experimental designs (SCEDs) are frequently used to evaluate whether a functional relation exists between interventions and student outcomes. A critical factor in decision making is the evaluation of graphical data, typically displayed in time-series graphs. Distortion in the graphical display of data can lead to invalid decisions on…

To support and better understand how to scale effectively, in 2020, the Millions Learning project at the Center for Universal Education (CUE) at Brookings joined the Global Partnership for Education's (GPE) Knowledge and Innovation Exchange (KIX), a joint partnership between GPE and the International Development Research Centre (IDRC), to…

To support and better understand how to scale effectively, in 2020, the Millions Learning project at the Center for Universal Education (CUE) at Brookings joined the Global Partnership for Education's (GPE) Knowledge and Innovation Exchange (KIX), a joint partnership between GPE and the International Development Research Centre (IDRC), to…

Single-case research designs (SCRDs) are rigorous methods used to investigate the effects of interventions on socially important outcomes. A hallmark of SCRDs is repeated measurement of observable behavior presented in time-series graphs. The construction of time-series graphs can inflate Type I or Type II errors made via visual analysis. In the…

Causal-formative indicators are often used in social science research. To achieve identification in causal-formative indicator modeling, constraints need to be applied. A conventional method is to constrain the weight of a formative indicator to be 1. The selection of which indicator to have the fixed weight, however, may influence statistical…

The aim of this study is to compare the results of correlation coefficient estimation of reliability with those obtained through the Bland-Altman plot technique. The scale was first divided into two halves using three different approaches. A linear and high-level relationship was found between the scale scores obtained from the halved forms.…

In educational research, scales are often presented as the ontological reality of a study. This study problematises this starting point and suggests approaching scales as experienced and epistemically used. Thus, this study asks how international students studying at Finnish universities during the early phase of the COVID-19 pandemic negotiated…