Unfolding models are frequently used to develop scales for measuring attitudes. Recently, unfolding models have been applied to examine rater severity and accuracy within the context of rater-mediated assessments. One of the problems in applying unfolding models to rater-mediated assessments is that the substantive interpretations of the latent…

We investigated whether and to what extent different scoring instructions, timing conditions, and direct feedback affect performance and speed. An experimental study manipulating these factors was designed to address these research questions. According to the factorial design, participants were randomly assigned to one of twelve study conditions.…

In this study, we examined the scoring and generalizability assumptions of an explicit instruction (EI) special education teacher observation protocol using many-faceted Rasch measurement (MFRM). Video observations of classroom instruction from 48 special education teachers across four states were collected. External raters (n = 20) were trained…

Psychologists and mathematics educators have long viewed flexibility as critical to students' mathematical development. In this paper, we focused on the multidimensional nature of flexibility to better understand how preference, knowledge, and use of effective methods for solving algebra problems are related. In Study 1, we identified…

Rubric-referenced calibration and the interaction between writing achievement and calibration, a measure of the relationship between one's performance and the accuracy of one's judgments, were investigated. Undergraduate students (N = 596) were assigned to one of three calibration conditions: (a) global, (b) global and general criteria, or (c)…

The purpose of this research was to examine the effects of instruction on students' generation of questions when reading multiple documents. Participants were 151 undergraduate students who were randomly assigned to one of two conditions: a treatment condition that received question generation instruction and a control condition that did not…

This study explored the effects of processing texts in print or digitally on readers' comprehension, processing time, and calibration. Eighty-six undergraduates read print and digital versions of book excerpts about childhood ailments presented in counterbalanced order. Comprehension was tested at three levels (i.e., main idea, key points, and…

This study explored differences that might exist in comprehension when students read digital and print texts. Ninety undergraduates read both digital and print versions of newspaper articles and book excerpts on topics of childhood ailments. Prior to reading texts in counterbalanced order, topic knowledge was assessed and students were asked to…

This study examined the impact of teaching creativity in the form of associative thinking strategies within a metacognitive framework. A representative sample of 30 university design students was selected from a larger section (N = 122) to participate in a 16-week supplemental course. Each week a new creative thinking strategy was integrated with…

The authors examined the ecological validity of using observation-based scores to evaluate individual teachers' effectiveness, mirroring their use by school administrators. Using the Classroom Assessment Scoring System, the authors asked (a) how similar are teachers' emotional support, classroom organization, and instructional support scores from…

This study compared 5 scoring methods in terms of their statistical assumptions. They were then used to score the Teacher Observation of Classroom Adaptation Checklist, a measure consisting of 3 subscales and 21 Likert-type items. The 5 methods used were (a) sum/average scores of items, (b) latent factor scores with continuous indicators, (c)…

This study was designed to forge stronger theoretical and empirical links between achievement goal theory and attribution theory. High school students ("N" = 224) completed a self-report survey that assessed 3 types of achievement goals, 7 types of attributions, and self-efficacy. Results indicated that students' adoption of achievement…

Although test scores from similar tests in multiple choice and constructed response formats are highly correlated, equivalence in rankings may mask differences in substantive strategy use. The author used an experimental design and participant think-alouds to explore cognitive processes in mathematical problem solving among undergraduate examinees…

It is important, when writing opinion essays, for students to consider and integrate both arguments and counterarguments to develop a final conclusion. In this article, the authors explored the effect of criteria instruction and a graphic organizer to promote integration of arguments and counterarguments. The researchers randomly assigned 84…