School leadership research literature has a large number of widely used constructs. Could fewer constructs bring more clarity? This study evaluates construct content validity, defined as the extent to which a measure's items reflect a theoretical content domain, in school leadership literature. To do so, we reviewed 29 articles that used Teaching…

Recent literature in the field of L2 vocabulary assessment has advocated for the development of written receptive vocabulary tests such as Vocabulary Levels Tests (VLTs) that use: (a) meaning-recall item formats, (b) a minimum of 40 item counts per 1,000-frequency band to improve level estimates, and (c) lemmas (not word-families) as the lexical…

In scientific research on creativity, there has been considerable debate concerning the criteria by which a production can be judged more or less creative, that is, about the definition of "creativity." The most frequent definition -- the "standard" definition -- incorporates the criteria of "novelty" and…

Conceptual replications have received increased coverage in the educational research agenda. This article argues for clarity in, and justification of, the definition, scope, and boundaries of a conceptual replication and what it can and cannot do. It argues for clear justifications when changing components from those of the original study. The…

We describe the use of think alouds to examine substantive processes involved in performance on a formative assessment of computational thinking (CT) designed to support self-regulated learning (SRL). Our task design model included three phases of work on a computational thinking problem: forethought, performance, and reflection. The cognitive…

Reflection is a key component of the transformative learning process. In this study, we take steps to define components of reflection and link them to a computer-based, quantitative method of content analysis called Linguistic Inquiry and Word Count (LIWC). This method can be used to evaluate common forms of reflective writing such as journals,…

There is something about the topic of validity that seems to provoke dissatisfaction in many of those who encounter it--a sense that something is not right, and that something needs to be done to sort it out. Paul E. Newton in his target essay does not attempt a radical reconstruction of the validity edifice. His position is that the "consensus…

This paper presents the authors' critique on "Clarifying the Consensus Definition of Validity" by Paul E. Newton (this issue). There are serious differences of opinion regarding the topic of validity. Newton is aware of these differences, as made clear by his choice of references and particularly his effort to respond to the various Borsboom…

One of the most critical steps in the test development process is defining the construct, or the knowledge, skills, or abilities, to be assessed. This foundational step provides the basis for initial assumptions about the meaning of test scores and serves as a reference for subsequent validity research. In this paper, we describe the purpose of…

Lee Cronbach once expressed the view that all roads lead to construct validity. In looking to clarify the consensus definition of validity, and its place in assessment, Newton is also led to the troublesome idea of construct validity. To be sure, he addresses other validity issues, but in this commentary, I will restrict my attention to construct…

The literature and the employee and workforce surveys rank collaborative problem solving (CPS) among the top 5 most critical skills necessary for success in college and the workforce. This paper provides a review of the literature on CPS and related terms, including a discussion of their definitions, importance to higher education and workforce…

The 1999 "Standards for Educational and Psychological Testing" defines validity as the degree to which evidence and theory support the interpretations of test scores entailed by proposed uses of tests. Although quite explicit, there are ways in which this definition lacks precision, consistency, and clarity. The history of validity has taught us…

Poor construct definition has characterized research on virtue, beginning with Hartshorne and May's honesty studies and continuing to the present. Recently, scholars have begun to define virtues in ways that improve the prospects for measuring virtue constructs, but a coordinated, programmatic approach is necessary for success in virtue…

Research indicates that many elementary students do not comprehend that the equal sign is an indication that an equality relation exists between two structures. Instead, they perceive the equal sign as an indication that a particular procedure is to be performed. As students mature, and as their exposure to the equal sign and equality relations in…

The author's doctoral work involved relating abilities in play to the results of a developmental assessment. She found them to be highly correlated, which should have made her happy. Instead she was troubled by the results. The skills that children use in play are important. Given materials that appeal to them and that "pull for" the desired skill…