In this article, Julia So discusses the purpose of program assessment, four common missteps of program assessment and reporting, and how to prevent them. The four common missteps of program assessment and reporting she has observed are: (1) unclear or ambiguous program goals; (2) measurement error of program goals and outcomes; (3) incorrect unit…

Item response theory (IRT) models typically rely on a normality assumption for subject-specific latent traits, which is often unrealistic in practice. Semiparametric extensions based on Dirichlet process mixtures (DPMs) offer a more flexible representation of the unknown distribution of the latent trait. However, the use of such models in the IRT…

While early career researchers (ECRs) often read and produce articles for peer reviewed journals, they are of ten less familiar with peer review reports (PRRs). Most ECRs learn about the genre of PRRs by reading reports written about their authored manuscripts, and through hands-on experience crafting their own PRRs, albeit often with little…

To be successful in producing improvement, assessment must be "part of a larger set of conditions that promote change" (Astin et al. 1992). To identify the enduring principles likely to produce the specific conditions to promote change, the author turned to two sources: (1) W. Edwards Deming's classic 1982 book, "Out of the Crisis:…

To convert accelerometer-based devices onto the same scale, a platform called Monitor-Independent Movement Summary (MIMS) was created and used in national studies. Yet, its physical activity (PA) intensity cutoff scores have not been established, making it less useful. This study was to link MIMS with the ActiGraph Count, known as "the…

Assessment is usually considered as an afterthought in the instructional design process. Given the many challenges of assessment design--and the lack of ready solutions--teachers may fall back on familiar forms of assessments and hope for the best. As a result, the problem is not a lack of will on the part of teachers. Instead, it is the lack of…

The partial correlation coefficient (PCC) is used to quantify the linear relationship between two variables while taking into account/controlling for other variables. Researchers frequently synthesize PCCs in a meta-analysis, but two of the assumptions of the common equal-effect and random-effects meta-analysis model are by definition violated.…

Evidence-based programs and grassroots programs are often adapted during implementation. Adaptations are often hidden, ignored, or punished. Although some adaptations stem from lack of organizational capacity, evaluators report other adaptations happen in good faith or are efforts to better fit the local context. Program implementers, facilitators…

Interviewees sometimes deliberately omit reporting some information. Such omission lies differ from other lies because all the information interviewees present may be entirely truthful. Truth tellers and lie tellers carried out a mission. Truth tellers reported the entire mission truthfully. Lie tellers were also entirely truthful but left out one…

The causal view of categories assumes that categories are represented by features and their causal relations. To study the effect of causal knowledge on categorization, researchers have used Bayesian causal models. Within that framework, categorization may be viewed as dependent on a likelihood computation (i.e., the likelihood of an exemplar with…

The sociologies of quantification, university rankings, and infrastructure are a loosely connected set of scholarly endeavors. Research in these areas typically examines production of certain types of quantification, their effects, and institutionalization. Despite these commonalities, scholars have noted a lack of conceptual coherence, debates on…

When reevaluating the educational landscape and aiming to incorporate movement into the day, remember that all exercise is not created equal. We recommend creating a model to evaluate the level of student exercise within an organization. The four-level framework discussed in this column can be used to evaluate exercise and sedentariness within an…

Assessing students' writing performance is essential to adequately monitor and promote individual writing development, but it is also a challenge. The present research investigates a benchmark rating procedure for assessing texts written by upper-elementary students. In two studies we examined whether a benchmark rating procedure (1) leads to…

Many studies have found that supported employment (SE) has effectively helped people with severe mental illness obtain and maintain competitive employment. However, most SE studies have asked "What works?" rather than discerning what works for whom, in what circumstances, in what respects and how. It is important to understand the…

Construct maps and related item type frameworks, which respectively describe and identify common patterns in student reasoning, provide teachers with tools to support instruction built upon students' intuitive thinking. We present a methodological approach--embedded within common assessment development processes--for developing such construct maps…