What does it mean to compare sets of objects along a scale, for example by saying "the men are taller than the women"? We explore comparison of pluralities in two experiments, eliciting comparison judgments while varying the properties of the members of each set. We find that a plurality is judged as "bigger" when the mean size of its members is…

This article describes Participatory Training Evaluation Method (PATEM) of measuring participants' reaction to the training. PATEM provides rich information; allows to document evaluation findings; becomes organic part of the training that helps participants process their experience individually and as a group; makes sense to participants; is an…

Theory-based evaluation (TBE) is an evaluation method that shows how a program will work under certain conditions and has been supported as a viable, evidence-based option in cases where randomized trials or high-quality quasi-experiments are not feasible. Despite the model's widely accepted theoretical appeal there are few examples of its…

Background: Although pediatric healthcare organizations have widely implemented the philosophy of family-centered care (FCC), evaluators and health professionals have not explored how to preserve the philosophy of FCC in evaluation processes. Purpose: To illustrate how fourth generation evaluation, in theory, could facilitate collaboration between…

We propose a functional version of extended redundancy analysis that examines directional relationships among several sets of multivariate variables. As in extended redundancy analysis, the proposed method posits that a weighed composite of each set of exogenous variables influences a set of endogenous variables. It further considers endogenous…

Critical appraisal of the research literature is an essential step in informing and implementing evidence-based practice. Quality appraisal tools that assess the methodological quality of experimental studies provide a means to identify the most rigorous research suitable for evidence-based decision-making. In single-subject experimental research,…

Students' poor performance on national assessments of writing suggests that educators need effective approaches to assess and intervene with writing problems. Brief experimental analysis (BEA) has supporting evidence for identifying interventions in reading, but little research has investigated BEA with writing. Early writing is an especially…

Assessment of learning has become very important for government, universities and accrediting agencies. In this article, two variables are examined, leadership and teamwork, in the context of a survey used by one mid-south university for assessment purposes. This survey demonstrates the problems that arise when the sequential steps of the research…

Forty-nine percent of the 706 articles published in the "Journal of Agricultural Education" from 1995 to 2012 reported quantitative research with at least one variable measured by a Likert-type scale. Grounded in the classical test theory definition of reliability and the tenets basic to Likert-scale measurement methodology, for the…

In 1916 Robert Frost published his famous poem, "The Road Not Taken," in which he muses about what might have been had he chosen a different path, made a different choice. While counterfactual arguments in general can often lead to vacuous nowheres, frequently in statistics the data that are not presented actually exist, in a sense,…

As standardized assessments tied to the Common Core standards approach for K-12 students, U.S. teachers correctly feel that how we test students will change. Will students be ready for tests of proficiency done on computers? Gullen debriefed with 500 students in various grades who had just taken pilot assessment items connected to the coming…

I argue in this article that digital composing practices require composition teachers to rethink the way we articulate learning outcomes and conduct classroom assessment. To accomplish this, we must revise the language we use to talk about outcomes and assessment in the context of new media. We also need to better understand how technologies are…

The measures of institutional success are more meaningful through the further realization of the institution's vision and mission and how the institution is supporting its declared values through various initiatives and behaviours. Institutions and their leaders rely on these statements as foundational pillars by which to launch new programs,…

Assessment is primarily a matter of judgement rather than measurement, yet for too long the nation has been pretending that pupils' attainment and measurement can be measured in increasingly fine detail (one APS "point" being one sixth of an original National Curriculum level). The lack of validity and reliability of this approach…

This article explores the relationship between federal and state educational policymaking and classroom reading instruction. The past 50 years of federal literacy education policy is summarized, particularly emphasizing the connections of these policies to reading curriculum and classroom assessment. The paper concludes with a discussion of the…