Proposes a method for performing survival analysis with latent variables with dual aims of scoring subjects with respect to a psychological variable of interest and distinguishing the varying extents to which items are capable of measuring the construct. Illustrates this discrete proportional hazards model. (SLD)

Discusses techniques used to ensure consistent scoring of written student responses in such subjects as reading, mathematics, writing, science, geography, U.S. history, and civics. Describes selecting scorers and image scoring and monitoring. (SLD)

Engineering education, like many fields, has started to explore the benefits of concept maps as an assessment technique for knowledge integration. Because they allow students to graphically link topics and represent complex interconnections among diverse concepts, we argue that concept maps are particularly appropriate for assessing…

Despite the growing number of collaborations between volunteers and professional scientists, research efforts investigating the impacts of such collaborations, which we have termed Public Participation in Scientific Research (PPSR), have been very limited. Examples of PPSR projects include citizen science, volunteer monitoring, and participatory…

The purpose of this study was to examine the relationships of learning style characteristics to self-directed learning propensity among adult learners. The learning style characteristics investigated were learning style balance as measured by a scoring method developed by Mainemelis, Boyatzis, and Kolb (2002) and learning style dimensions as…

In this study, we describe a framework for monitoring rater performance over time. We present several statistical indices to identify raters whose standards drift and explain how to use those indices operationally. To illustrate the use of the framework, we analyzed rating data from the 2002 Advanced Placement English Literature and Composition…

This is an empirical examination of the quality of teacher assignments and student work in Singapore schools. Using a theoretical framework based on principles of authentic assessment and intellectual quality, two sets of criteria and scoring rubrics were developed for the training of expert teachers to judge the quality of assignments and student…

This article describes how a diverse, interdisciplinary team of faculty formed a topic-based faculty learning community. Following an introduction to faculty learning communities and a brief discussion of their benefit to faculty engaged in the process of adopting new technology, we explain how our team, through a competitive mini-grant…

By centralizing the issue of test fairness in language proficiency assessments, this study responds to a call by researchers for developing greater social responsibility in the language testing agenda. As inquiries into language attitude and psychology indicate, there is an underlying uncertainty pertaining to the validity of test use and score…

The purpose of this study was to explore the effectiveness of using learner-generated and instructor-provided multimedia annotations on foreign language reading comprehension and attitudes. The four research questions are: (1) what are the effects of using different multimedia annotations on reading comprehension for learners of different…

This essay proposes that there is one process but many points of departure for religious education. Each point of departure requires its own construct to facilitate learning. The constructs presented are Bloom's taxonomy of learning outcomes in the cognitive domain, Groome's "shared Christian praxis," the lectio divina, the Ignatian rules of…

All teachers do assessments. Biology teachers, by grading exams, quizzes, papers, and lab reports, assess mostly "knowledge." An important part of being a modern biologist, however, is the ability to perform certain technical or manual skills (known in the trade as "techniques") such as running gels, pipetting, recording from excitable cells with…

Lissitz and Samuelsen (2007) argue that the unitary conception of validity for educational assessments is too broad to guide applied work. They call for attention to considerations and procedures that focus on "test development and analysis of the test itself" and propose that those activities be collectively termed "content validity." The author…

This article summarizes the continuous latent trait IRT approach to skills diagnosis as particularized by a representative variety of continuous latent trait models using item response functions (IRFs). First, several basic IRT-based continuous latent trait approaches are presented in some detail. Then a brief summary of estimation, model…

This study compares five scoring approaches for a test of clinical reasoning skills. All of the approaches incorporate information about the correct item responses selected and the errors, such as selecting too many responses or selecting a response that is inappropriate and/or harmful to the patient. The approaches are combinations of theoretical…