The use of large-scale assessments (LSAs) in education has grown in the past decade though analysis of LSAs using multilevel models (MLMs) using R has been limited. A reason for its limited use may be due to the complexity of incorporating both plausible values and weighted analyses in the multilevel analyses of LSA data. We provide additional…

The synthetic control method (SCM) is a popular approach for estimating the impact of a treatment on a single unit with panel data. Two challenges arise with higher frequency data (e.g., monthly versus yearly): (1) achieving excellent pre-treatment fit is typically more challenging; and (2) overfitting to noise is more likely. Aggregating data…

The purpose of this study was to demonstrate the effectiveness level of the Provus-Alkin-amalgamation evaluation application based on Weighted-Product-"Rwa-Bhineda" modification through the results of field trials. This evaluation application was an evaluation tool formed by a combination of educational evaluation models (Provus model…

Reweighting a distribution to minimize a distance to a target distribution is a powerful and flexible strategy for estimating a wide range of causal effects, but can be challenging in practice because optimal weights typically depend on knowledge of the underlying data generating process. In this paper, we focus on design-based weights, which do…

The purpose of this occasional paper is to compare point estimates and trends included in the Monitoring the Future (MTF) Panel Study annual report: "National Data on Substance Use among Adults Ages 19 to 60, 1976-2021" prepared using historical post-stratification weights, with the same point estimates and trends obtained when using MTF…

Statistical process control (SPC) charts have been widely used in the field of educational measurement. The cumulative sum (CUSUM) is an established SPC method to detect aberrant responses for educational assessments. There are many studies that investigated the performance of CUSUM in different test settings. This paper describes the CUSUM…

One commonly used compromise standard-setting method is the Beuk (1984) method. A key assumption of the Beuk method is that the emphasis given to the pass rate and the percent correct ratings should be proportional to the extent that the panelists agree on their ratings. However, whether the slope of Beuk line reflects the emphasis that panelists…

Propensity score matching and weighting methods are applied to balance covariates and reduce selection bias in the analysis of observational study data, and ultimately estimate a treatment effect. We wish to evaluate the impact of a Supplemental Instruction (SI) program on student success in an Introductory Statistics course. In such student…

The article highlights the growing significance of flexible assessment in higher education as institutions adapt to the increasingly diverse needs of their student populations. The demand for customizable educational experiences, heightened by the COVID-19 pandemic, has made flexibility in assessment essential for sustaining and improving student…

Performance in primary education can be measured in terms of different variables, like enrolment rate, attendance rate, or levels of learning achievement of students. Thus, for an analysis of the comparative performance of units, like country, state, or district, we need an aggregate measure or an index developed from these variables. In…

Mediation analysis plays an important role in understanding causal processes in social and behavioral sciences. While path analysis with composite scores was criticized to yield biased parameter estimates when variables contain measurement errors, recent literature has pointed out that the population values of parameters of latent-variable models…

Recent research has suggested that re-setting the standard for each administration of a small sample examination, in addition to the high cost, does not adequately maintain similar performance expectations year after year. Small-sample equating methods have shown promise with samples between 20 and 30. For groups that have fewer than 20 students,…

The "Morbidity and Mortality Weekly Report" ("MMWR") series of publications is published by the Office of Science, Centers for Disease Control and Prevention (CDC), U.S. Department of Health and Human Services. Articles included in this supplement are: (1) Overview and Methods for the Youth Risk Behavior Surveillance System --…

The goal of this article is to introduce the revised Conceptual Understanding Weighting System (CUWS) Greene & Shorter (2012, Trans. Dial.), a tool for categorizing and weighting a mathematical task in order to identify the level of conceptual understanding being assessed by the task. In addition, there is discussion of how this weighting…

World university rankings use the weight-and-sum approach to process data. Although this seems to pass the common sense test, it has statistical problems. In recent years, seven such problems have been uncovered: spurious precision, weight discrepancies, assumed mutual compensation, indictor redundancy, inter-system discrepancy, negligence of…