This article describes 5 experiments investigating the role of prior knowledge in incidental category learning. Experiments 1 to 3 showed that prior knowledge improved learning only if the categories in a given set were related to contrasting themes; there was no consistent knowledge effect if the categories were related to the same theme.…

As researchers at a testing organization concerned with the appropriate uses and validity evidence for our assessments, we provide an applied perspective related to the issues raised in the focus article. Newton's proposal for elaborating the consensus definition of validity is offered with the intention to reduce the risks of inadequate…

In a recent state-of-the-art (SoA) article (Stoynoff 2009), I reviewed some of the trends in language assessment research and considered them in light of validation activities associated with four widely used international measures of L2 English ability. This Thinking Allowed article presents an opportunity to revisit the four broad areas of L2…

Current educational policies rely on educational assessments. However, the technical aspects of assessments are often unknown to policy makers, which is dangerous because sound assessment policy requires knowledge of the strengths and limitations of educational tests. In this article, we discuss the importance of informing policy makers of…

In three experiments, we evaluated remembering and intentional forgetting of attitude statements that were either congruent or incongruent with participants' own political attitudes. In Experiment 1, significant directed forgetting was obtained for incongruent statements, but not for congruent statements. In addition, in the remember group, recall…

This study outlines a new explanation for homophily in social networks that is neither intended nor imposed by constraints on partner choices. Rather, homophily is an endogenous product of the emergent exchange process, in which actors seek high-value partners who reciprocate their gestures. Whereas all actors initially direct exchange toward…

The current study examined individual differences in the effects of retrieval from long-term memory (i.e., the testing effect). The effects of retrieving from memory make tested information more accessible for future retrieval attempts. Despite the broad applied ramifications of such a potent memorization technique there is a paucity of research…

This paper discusses issues regarding the validity and reliability of psychoeducational assessments provided to Disability Services Offices at Canadian Universities. Several vignettes illustrate some current issues and the potential consequences when university students are given less than thorough disability evaluations and ascribed diagnoses.…

At a time when U.S. political and business leaders are raising concerns about the need to better nurture creativity and innovative thinking among young people, several states are exploring the development of an index that would gauge the extent to which schools provide opportunities to foster those qualities. In Massachusetts, a new state…

Assessment of performance, when national standards are required, has to be sustained by confidence. Confidence in the learner that they are engaged in learning that will provide them with a qualification that is worthwhile, and the confidence of the end user that the assessment is rigorous, equitable institution to institution, and accurate.…

The mental model theory postulates that the meanings of assertions, and knowledge about their context can "modulate" the logical meaning of sentential connectives, such as "if" and "or". One known effect of modulation is to block the representation of possibilities to which a proposition refers. But, modulation should also add relational…

This paper defines the terms "hypothesis," "prediction," and "conclusion" and shows how to use the terms correctly in scientific investigations in both the school and science education research contexts. The scientific method, or hypothetico-deductive (HD) approach, is described and it is argued that an understanding of the scientific method,…

There is a substantial literature on attempts to obtain information on the proficiency of respondents from distractors in multiple choice items. Information in a distractor implies that a person who chooses that distractor has greater proficiency than if the person chose another distractor with no information. A further implication is that the…

Errors don't exist in our data, but they serve a vital function. Reality is complicated, but our models need to be simple in order to be manageable. We assume that attributes are invariant over some conditions of observation, and once we do that we need some way of accounting for the variability in observed scores over these conditions of…

In response to the low standards in short form development, Smith, McCarthy, and Anderson (2000) introduced a set of guidelines for the construction and evaluation of short forms of psychological tests. One of their recommendations requires researches to show that the variance overlap between the short form and its long form is adequate. This…