While different approaches to evaluation will yield different results, depending on the purpose of the evaluation this article describes an evaluation approach that was aimed at investigation of the mental models of users of the programme. The study was driven by questions about the differences in mental models of the instructional designers and…

Recent research on annotation interfaces provides provocative evidence that anchored, annotation-based discussion environments may lead to better conversations about a text. However, annotation interfaces raise complicated tradeoffs regarding screen real estate and positioning. It is argued that solving this screen real estate problem requires…

This book examines the "think aloud method," which asks people to think aloud while solving a problem so that the resulting protocol can then be analyzed to answer questions about problem solving behavior. The method is presented in detail in the book, along with examples. The book finds that the method is useful both for psychological…

This paper details a study of knowledge-building activities in the domain of computer software. Thirty-six adults--evenly split among beginning, intermediate, and advanced knowledge levels--were videotaped while they attempted to learn a common spreadsheet package. Subjects were asked to think aloud while learning. Each knowledge building activity…

An exploratory study investigated how writers represent their task to themselves before beginning to write. Using data from verbal protocols, the initial plans of 12 writers (5 experts and 7 student writers) who were working on an expository writing task were examined. The protocols were coded for types of planning. Independent measures of the…

Noting that recent issues of several scholarly journals have contained criticism of protocol analysis and the use of verbal reports in the analysis of the writing process, this paper examines some of the charges made and then explores the implications of the criticisms. Specific charges addressed in the paper include the following: (1) protocols…

An order form used in a university printing office was evaluated, redesigned, and tested to determine whether the original or the revised version could be completed more quickly and accurately. Two types of subjects were used: six "experienced" subjects who had previously used the old version of the form, and six "novice" subjects who had never…

Claims recent research involving premature editing--thinking aloud for the study--is too narrow in scope to allow for basic writers whose writing processes do not resemble the model. Using eight basic writers produces evidence to support the claim that many or most basic writers can write without editing prematurely.(NH)

Looks at the nature of introspective accounts and the usefulness of such accounts in studies of the composing process. Concludes that retrospective journal accounts are a rich source of information because they permit consideration of the complex context in which composing occurs. (FL)

A student's understanding of a problem before he or she solves it is a critical component of successful problem solving. This understanding is based on how a problem is represented; that is, whether a problem is understood in terms of principles or solution methods or whether the focus is on features that are irrelevant to its solution. In this…

Reviews research on thinking aloud in reading comprehension that considers thinking aloud as a method of inquiry, a mode of instruction, and a means for encouraging social interaction. Current efforts in engaging students in constructing meaning from text in collaborative discussions indicate the increased importance of social interaction in…

Discusses the components of a new methodology--consensual qualitative research (CQR)--which uses words to describe phenomena and which recognizes the importance of context. Locates CQR within the qualitative research tradition and details ways to develop a focused topic area, choose a team, attend to group dynamics, and other important issues.…

Offers methodological and epistemological suggestions regarding consensual qualitative research (CQR). Discusses the scope of CQR, the illusion of representativeness, dialogical understanding, the problem of commonality as a goal, and difficulties with the CQR consensus procedure. Epistemological concerns include the nature of truth, objective…

Discusses advantages and limitations of six usability evaluation methods (heuristic evaluation, pluralistic walk-throughs, formal usability inspections, empirical methods, cognitive walk-throughs, and formal design analysis) and six data collection techniques (verbal reports, concurrent think-aloud method, questionnaire, video analysis,…

Builds up a profile of causal development in 10-year-olds based on their recall of history and science texts in which the amount of causal connectivity differed. Finds that causal connections play an important role in expository text recall, and that subjects who have a strong causal profile also, generally, perform well in English. (PA)