The development of expertise in writing is a complex but important achievement for young children as they become literate. Writing is a critical component of literacy development, yet there are few accounts of change over time in early writing development that attend to both changes in writing behaviors, the complexity of written messages, and the…

The purpose of the study was to investigate the extent to which raters coming from diverse backgrounds exhibited different levels of rating ability while scoring speaking performances. The study also aimed to examine how raters with different backgrounds could develop their rating ability over time. For this purpose, raters' background…

This paper proposes an alternative content measure for essay scoring, based on the "difference" in the relative frequency of a word in high-scored versus low-scored essays. The "differential word use" (DWU) measure is the average of these differences across all words in the essay. A positive value indicates the essay is using…

Automated essay scoring programs are becoming more common and more technically advanced. They provoke strong reactions from both their advocates and their detractors. Arguments tend to fall into two categories: technical and principled. This paper argues that since technical difficulties will be overcome with time, the debate ought to be held in…

This paper describes how a Many Faceted Rasch Measurement (MFRM) approach can be applied to performance assessment focusing on rater analysis. The article provides an introduction to MFRM, a description of MFRM analysis procedures, and an example to illustrate how to examine the effects of various sources of variability on test takers' performance…

National policy and standards documents, including the National Assessment of Educational Progress frameworks, the "Common Core State Standards" and the "Next Generation Science Standards," assert the need to assess critical-analytic thinking (CAT) across subject areas. However, assessment of CAT poses several challenges for…

We have created an inventory to characterize the teaching practices used in science and mathematics courses. This inventory can aid instructors and departments in reflecting on their teaching. It has been tested with several hundred university instructors and courses from mathematics and four science disciplines. Most instructors complete the…

The current study examined efficient modes for providing standardized feedback to improve performance on an assignment for a second year college class involving writing a brief research proposal. Two forms of standardized feedback (detailed rubric and proposal exemplars) were utilized is an experimental design with undergraduate students (N = 100)…

Management faculties often use cases, simulations, and research projects to achieve learning objectives in the Principles of Management class. This class typically aims to introduce students to the topics of "planning, organizing, coordinating, staffing, directing, budgeting, controlling, and evaluating functions of management; leadership…

Performance-based assessment clearly represents an indispensable approach for assessing gifted student learning. Challenging performance tasks allow gifted learners to reveal their considerable intellectual capacity and energy. Through performance tasks, teachers gain insights into a gifted student's true level of capability in a domain of…

A rubric was developed to evaluate laboratory reports written by undergraduate students of astronomy and astrophysics from Universidad Católica de Chile. The process of elaboration, peer validation, and application of the rubric to the evaluation of written tasks extended from August 2011 to August 2012. The instrument proved to be effective as an…

Amy Kenworthy and George A. Hrivnak share their thoughts in this commentary, writing that they were both stimulated by and written in response to Riebe and Jackson's article "Assurance of Graduate Employability Skill Outcomes Through the Use of Rubrics." Having read two iterations of that article, they highlight three key messages…

Objective: To examine the ability of medical students to identify hazardous drinkers using screening tools recommended in clinical practice. Design: Observational cross-sectional study. Setting: Faculty of Medicine of Castilla-La Mancha, Spain. Method: The medical students learnt to use Alcohol Use Disorders Identification Test (AUDIT) and…

Due to increasing demands regarding student learning outcomes and accreditation, a capstone portfolio was added to assess critical thinking and communication skills of geography majors at a large public university in the USA. The portfolio guidelines were designed to be adaptable to a flexible curriculum where about half of the requirements within…

The scoring of constructed responses may introduce construct-irrelevant factors to a test score and affect its validity and fairness. Fatigue is one of the factors that could negatively affect human performance in general, yet little is known about its effects on a human rater's scoring quality on constructed responses. In this study, we compared…