In scientific research on creativity, there has been considerable debate concerning the criteria by which a production can be judged more or less creative, that is, about the definition of "creativity." The most frequent definition -- the "standard" definition -- incorporates the criteria of "novelty" and…

Intelligence typically is defined as consisting of "adaptation to the environment" or in related terms. Yet, it is not clear that "general intelligence" or g, traditionally conceptualized in terms of a general factor in a psychometrically-based hierarchical model of intelligence, provides an optimal way of defining intelligence…

This article analyses research of theories and models of intelligence. It examines current developments in intelligence research, covering the formation of more complex and diverse intelligence theories. First, the article examines some of the widely used aptitude/intelligence tests include, such Stanford-Binet Intelligence Quotient, Wechsler…

This special issue of "Assessment in Education" contains the type of debate needed about what Cizek (2015) calls a "… lingering flaw in the concept of validity…." Some practitioners might not agree that the current theory of validation is flawed. Specifically, the debate Jon Twing is referencing concerns the role of the…

This paper examines the construct measured by automated essay scoring (AES) systems. AES systems measure features of the text structure, linguistic structure, and conventional print form of essays; as such, the systems primarily measure text production skills. In the current state-of-the-art, AES provide little direct evidence about such matters…

Most position descriptions for college and university faculty include benchmarks that indicate assumptions about collegiality. Criticism about this practice has been voiced for years. But case law in the United States has upheld the use of collegiality as a factor in decisions regarding faculty employment, tenure, and promotion. Indeed, several…

This policy brief provides principal evaluation system designers information about the technical soundness and cost (i.e., time requirements) of publicly available school climate surveys. The authors focus on the technical soundness of school climate surveys because they believe that using validated and reliable surveys as an outcomes measure can…

The prevailing assumption by some that deep processing promotes stronger learning outcomes while surface processing promotes weaker learning outcomes has been called into question by the inconsistency and ambiguity of results in investigations of the relation between levels of processing and performance. The purpose of this literature review is to…

Diagnostic assessment is currently an active research area in educational measurement. Literature related to diagnostic modeling has been in existence for several decades, but a great deal of research has been conducted within the last decade or so, especially within the last five years. The author summarizes the key components in the application…

"Diagnostic classification models" (DCM) are frequently promoted by psychometricians as important modelling alternatives for analyzing response data in situations where multivariate classifications of respondents are made on the basis of multiple postulated latent skills. In this review paper, a definitional boundary of the space of DCM…

Treatment integrity (also referred to as "treatment fidelity," "intervention integrity," and "procedural reliability") is an important methodological concerning both research and practice because treatment integrity data are essential to making valid conclusions regarding treatment outcomes. Despite its relationship to validity, treatment…

In this article, the author asks why we assume that we must define something before we can begin to understand it? Is that assumption a holdover from the predominantly behaviorist orientation of the 1950s when everything had to be measurable? Haven't we gotten past the paradigm of defining, measuring, then studying phenomena? If physicists had to…

This chapter considers the design of incentive pay systems for teachers and principals and the challenges facing policy makers who seek to design them. The author argues that policy makers must direct the efforts of teachers and principals toward schools' mission--the acquisition of skills and knowledge among children--and must find ways to link…

Reviews the Intimate Friendship Scale based on 16 studies relevant to children and preadolescents. Presents the conceptual background of the test. Addresses questions regarding the scale and suggests directions for future research. (DR)

Arguments are presented for conceptualizing validity within a postmodern approach. Validity, reliability, and generalizability have been a holy trinity of social science research, and standard definitions of validity have been taken from criteria developed for psychometric tests. From a postmodern point of view, validity is sometimes discarded as…