Across education, certification and licensure, there are repeated calls for the development of assessments that target "higher-order thinking," as opposed to mere recall of facts. A common assumption is that this necessitates the use of constructed response or essay-style test questions; however, empirical evidence suggests that this may…

Internationally, many assessment systems rely predominantly on human raters to score examinations. Arguably, this facilitates the assessment of multiple sophisticated educational constructs, strengthening assessment validity. It can introduce subjectivity into the scoring process, however, engendering threats to accuracy. The present objectives…

Background: "Thinking aloud" is a well-established method of data collection in education, assessment, and other fields of research. However, while many researchers have reported their views on its usage, the first-hand experiences of research participants have received less attention. Purpose: The aim of this exploratory study was to…

Social network analysis is increasingly used in the study of policy implementation and school leadership. A key question that remains is that of instrument validity--that is, the question of whether these social network survey instruments measure what they purport to measure. In this paper, we describe our work to examine the validity of the…

In the delivery of clinical services, outcomes monitoring (i.e., repeated assessments of a patient's response to treatment) can be used to support clinical decision making (i.e., recurrent revisions of outcome expectations on the basis of that response). Outcomes monitoring can be particularly useful in the context of established practice research…

Although protocol analysis can be an important tool for researchers to investigate the process of collaboration and communication, the use of this method of analysis can be time consuming. Hence, an automatic coding procedure for coding dialogue acts was developed. This procedure helps to determine the communicative function of messages in online…

As World Wide Web access expands into schools and homes, children will likely encounter the misinformation often found in this medium. This qualitative study describes strategies employed by sophisticated adult World Wide Web users as they evaluate authentic Web information with the purpose of adapting these strategies for children in K-12…