There has been growing interest in building and optimizing retrieval systems with respect to relevance and novelty of information, which together more realistically reflect the usefulness of a system as perceived by the user. How to combine these criteria into a single metric that can be used to measure as well as optimize retrieval systems is an…

The current study examined whether psychological reactance differs across compliant and non-compliant examinees. Given the lack of consensus regarding the factor structure and scoring of the Hong Psychological Reactance Scale (HPRS), its factor structure was evaluated and subsequently tested for measurement invariance (configural, metric, and…

This article describes an innovative and unique practice involving two classes of information technology (IT) major student teachers, who created digital learning resources and assessment rubrics by utilizing a Web 2.0 tool. The project spanned more than two weeks and data were collected from a number of sources, such as the content of the wiki…

The present research examined the reliability of three types of divergent thinking tasks (unusual uses, instances, consequences/implications) and two types of subjective scoring (an average across all responses vs. the responses people chose as their top-two responses) within a latent variable framework, using the maximal-reliability "H"…

Throughout the world, cut scores are an important aspect of a high-stakes testing program because they are a key operational component of the interpretation of test scores. One method for setting standards that is prevalent in educational testing programs--the Bookmark method--is intended to be a less cognitively complex alternative to methods…

This article explains how the authors are able to take results from a regular program of course-level assessment, use them to inform curricular changes, and then measure the learning in those revised courses to determine whether and which changes made a difference. The authors discuss why it was important for Kaplan University to implement…

This article describes a study conducted by Judith A. Hale and Debbie L. Page to identify the domains required for sustainable school improvement efforts. The results were used to develop a proficiency-based certification for school improvement specialists offered by the International Society for Performance Improvement. They were also used to…

Sex differences in adults' observations and ratings of children's aggression was studied in a sample of preschool children (N=89, mean age=44.00 months, SD=8.48). When examining the direct observations made by trained observers, male observers, relative to female observers, more frequently recorded aggressive bouts, especially of boys. On rating…

e-Learning plays an undoubtedly important role in today's education and assessment is one of the most essential parts of any instruction-based learning process. Assessment is a common way to evaluate a student's knowledge regarding the concepts related to learning objectives. In this paper, a new method for assessing the free text answers of…

ELTeach is an online professional development program consisting of two courses, English-for-Teaching and Professional Knowledge for English Language Teaching (ELT). Each course includes a coordinated assessment leading to a score report and certificate for individual teachers. Developed with reference to international and national teaching…

Rubric means red ochre--red earth--as in Bryce Canyon and Sedona. Red headers were used in medieval manuscripts as section or chapter markers, and you can bet that the Whore of Babylon got herself some fancy rubrics over the years. Through most of its history, the word has been attached to religious texts and liturgy; rubrics were used as…

In this guided inquiry, students investigate advantages and disadvantages of genetic engineering by integrating popular fiction into their study of bioethics. What are the effects of artificially created hybrid creatures on characters in "The Hunger Games" and in our society? What are the effects on and basic rights of the organisms…

This study examines the lexical representation and recall of abstract words by beginning L2 learners of Spanish in the light of the predictions of the dual coding theory (Paivio 1971; Paivio and Desrochers 1980). Ninety-seven learners (forty-four males and fifty-three females) were randomly placed in the picture or non-picture group and taught…

This study investigates the impact of raters' language background on their judgements of the speaking performance in the College English Test-Spoken English Test (CET-SET) of China, by comparing the rating patterns of non-native English-speaking (NNES) teacher raters, who are currently employed to assess performance on the CET-SET, with those of…

This study aimed to gain knowledge of students' beliefs and difficulties in understanding p-values, and to use this knowledge to develop improved teaching programs. This study took place over four consecutive teaching semesters of a one-semester tertiary statistics unit. The study was cyclical, in that the results of each semester were used to…