This paper extends existing work on teacher weighting in student-centered surveys by looking into aspects of practical implementation of deriving and using weights for teacher-centered analysis in the Trends in International Mathematics and Science Study (TIMSS) and the Progress in International Reading Literacy Study (PIRLS). The formal…

Performance in primary education can be measured in terms of different variables, like enrolment rate, attendance rate, or levels of learning achievement of students. Thus, for an analysis of the comparative performance of units, like country, state, or district, we need an aggregate measure or an index developed from these variables. In…

In institution research, surveys of students or faculty can be a helpful tool to gather data. Surveying a sample of students or faculty and computing weights to be able to make inferences to your student or faculty population are important. In this chapter, we introduce the connected topics of sampling and weighting. We begin with a discussion on…

Standard setting is arguably one of the most subjective techniques in test development and psychometrics. The decisions when scores are compared to standards, however, are arguably the most consequential outcomes of testing. Providing licensure to practice in a profession has high stake consequences for the public. Denying graduation or forcing…

Mediation analysis plays an important role in understanding causal processes in social and behavioral sciences. While path analysis with composite scores was criticized to yield biased parameter estimates when variables contain measurement errors, recent literature has pointed out that the population values of parameters of latent-variable models…

An increasing number of universities have implemented prior learning assessment (PLA), but little research has examined the non-course matching approach referred to as block credit PLA. Adult learners pursuing a college degree often bring professional competencies, knowledge, and skills to the classroom. PLA enables adult learners to earn college…

The NCVS is the nation's primary source of information on the nature of criminal victimization. The NCVS collects data each year from a nationally representative sample of households on the frequency, characteristics, and consequences of criminal victimization in the United States. Currently, the NCVS includes four supplemental surveys that are…

Propensity score (PS) adjustments have become popular methods used to improve estimates of treatment effects in quasi-experiments. Although researchers continue to develop PS methods, other procedures can also be effective in reducing selection bias. One of these uses clustering to create balanced groups. However, the success of this new method…

Recent research has suggested that re-setting the standard for each administration of a small sample examination, in addition to the high cost, does not adequately maintain similar performance expectations year after year. Small-sample equating methods have shown promise with samples between 20 and 30. For groups that have fewer than 20 students,…

The Mantel-Haenszel delta difference (MH D-DIF) and the standardized proportion difference (STD P-DIF) are two observed-score methods that have been used to assess differential item functioning (DIF) at Educational Testing Service since the early 1990s. Latentvariable approaches to assessing measurement invariance at the item level have been…

This article presents the pseudo-equivalent group approach and discusses how it can enhance the quality of linking in the presence of nonequivalent groups. The pseudo-equivalent group approach allows to achieve pseudo-equivalence using propensity score reweighting techniques. We use it to perform linking to establish scale concordance between two…

The weighting of a final exam or a final assignment is an essential part of course design that is rarely discussed in pedagogical literature. Depending on the weighting, a final exam or assignment may provide unequal benefits to students depending on their prior performance in the class. Consequently, uncritical grade weighting can discount…

The "Morbidity and Mortality Weekly Report" ("MMWR") series of publications is published by the Office of Science, Centers for Disease Control and Prevention (CDC), U.S. Department of Health and Human Services. Articles included in this supplement are: (1) Overview and Methods for the Youth Risk Behavior Surveillance System --…

We present an aggregation scheme that increases power in randomized controlled trials and quasi-experiments when the intervention possesses a robust and well-articulated theory of change. Intervention studies using longitudinal data often include multiple observations on individuals, some of which may be more likely to manifest a treatment effect…

Two families of analysis methods can be used for differential item functioning (DIF) analysis. One family is DIF analysis based on observed scores, such as the Mantel-Haenszel (MH) and the standardized proportion-correct metric for DIF procedures; the other is analysis based on latent ability, in which the statistic is a measure of departure from…