This paper examines the tension in the process of designing student surveys between the methodological requirements of good survey design and the institutional needs for survey data. Building on the commonly used argumentative approach to construct validity, I build an interpretive argument for student opinion surveys that allows assessment of the…

In this paper we develop an evidence-based framework for considering many of the factors affecting marker agreement in GCSEs and A levels. A logical analysis of the demands of the marking task suggests a core grouping comprising: (i) question features; (ii) mark scheme features; and (iii) examinee response features. The framework synthesises…

The challenges of accurate forensic assessment are aggravated when evaluatees have intellectual disabilities. Few studies have addressed the efficacy of forensic assessment in samples diagnosed with an intellectual disability, and those that have typically focus on measures of cognitive effort rather than on feigned psychiatric symptoms. This…

We successfully integrated science and language arts in a third-grade classroom. The students used "scientist's eyes" and "poet's eyes" to write original poetry. In addition, they created habitat posters about a swamp organism. Scoring guides for the habitat poems and posters are also included. (Contains 5 figures and 2 tables.)

Purpose: This paper seeks to discuss the characteristics that describe a rubric. It aims to propose a systematic method for developing curriculum wide rubrics and to discuss their potential utility for program quality assessment. Design/methodology/approach: Implementation of rubrics is a recent phenomenon in higher education. Prior research and…

This article presents a new instructional model called Argument-Driven Inquiry (ADI) that can be used in undergraduate college chemistry laboratory courses. ADI is designed to provide students with an opportunity to develop their own method to generate data, to carry out investigations, use data to answer research questions, write, and be more…

Background: Family quality of life (FQOL) has emerged as an important outcome of service delivery for individuals with disabilities and their families. The purpose of this review was to explore the disparity of scale development approaches between families with children with disabilities and families from other populations and identify strengths…

The Script Concordance Test (SCT) uses a panel-based, aggregate scoring method that aims to capture the variability of responses of experienced practitioners to particular clinical situations. The use of this type of scoring method is a key determinant of the tool's discriminatory power, but deviant answers could potentially diminish the…

It has been known for some time that item response theory (IRT) models may exhibit a likelihood function of a respondent's ability which may have multiple modes, flat modes, or both. These conditions, often associated with guessing of multiple-choice (MC) questions, can introduce uncertainty and bias to ability estimation by maximum likelihood…

Longitudinal research has demonstrated a link between exposure to sexual content in media and subsequent changes in adolescent sexual behavior, including initiation of intercourse and various noncoital sexual activities. Based on a reanalysis of one of the data sets involved, Steinberg and Monahan (2011) have challenged these findings. However,…

Defined as the systematic study of teaching and learning made public, scholarship of teaching and learning (SoTL) has drawn increasing attention from faculty members and institutions in recent years, perhaps as a response to rising demands for accountability and evidence-based teaching practices. However, the process of setting up a SoTL project,…

Value-added modeling is an alternative approach to test-based accountability systems based on the proportions of students scoring at or above pre-determined proficiency levels. Value-added modeling techniques provide opportunities to estimate an individual teacher's effect on student learning, while allowing for the possibility to control for the…

A generic approach in automated essay scoring produces scores that have the same meaning across all prompts, existing or new, of a writing assessment. This is accomplished by using a single set of linguistic indicators (or features), a consistent way of combining and weighting these features into essay scores, and a focus on features that are not…

Information provided by examination of the skills that underlie holistic scores can be used not only as supporting evidence for the validity of inferences associated with performance tests but also as a way to improve the scoring rubrics, descriptors, and benchmarks associated with scoring scales. As fluency is considered a critical, perhaps…

This paper introduces the Individualized Classroom Assessment Scoring System (inCLASS), an observation tool that targets children's interactions in preschool classrooms with teachers, peers, and tasks. In particular, initial evidence is reported of the extent to which the inCLASS meets the following psychometric criteria: inter-rater reliability,…