Among the surprising results of research on the relation between a person's material circumstances and his or her subjective well-being was the finding that this relationship appears to be rather weak (throughout this paper the terms "(general) life satisfaction", "(subjective) satisfaction", "happiness" and…

The rank-ordering method for standard maintaining was designed for the purpose of mapping a known cut-score (e.g. a grade boundary mark) on one test to an equivalent point on the test score scale of another test, using holistic expert judgements about the quality of exemplars of examinees' work (scripts). It is a novel application of an old…

A methodology is described that teaches science process by combining informal logic and a heuristic for rating factual reliability. This system facilitates student hypothesis formation, testing, and evaluation of results. After problem solving with this scheme, students are asked to examine and evaluate arguments for the underlying principles of…

This study sought to explore the relationship between attendance in public prekindergarten programs and school readiness skills using regression discontinuity methodology. A sample of 179 students entering prekindergarten and 67 students entering kindergarten who had completed prekindergarten the previous year was collected with parental consent…

Objective: Symptoms of overactivity form part of the "DSM-IV" criteria for the combined or hyperactive-impulsive subtypes of attention-deficit/hyperactivity disorder (ADHD); yet little data exist that would quantify the nature of the overactivity component. We aimed to quantify the ability of four different measures of motion sensor data, taken…

Many exam programs have begun to include innovative item types in their operational assessments. While innovative item types appear to have great promise for expanding measurement, there can also be genuine challenges to their successful implementation. In this paper we present a set of four activities that can be beneficially incorporated into…

Differential item functioning (DIF) analysis is a statistical technique used for ensuring the equity and fairness of educational assessments. This study formulates a new DIF analysis method using the information similarity index (ISI). ISI compares item information functions when data fits the Rasch model. Through simulations and an international…

The CourseMarker system has been used to assess free-response computer based assessment (CBA) exercises since 1998. The aim of the studies reported here was to evaluate the feasibility and usefulness of developing and deploying diagram-based exercises using DATsys, an authoring environment for diagram-based CBA, together with CourseMarker.…

This article describes the results of a simulation study to investigate the impact of missing data on the detection of differential item functioning (DIF). Specifically, it investigates how four methods for dealing with missing data (listwise deletion, zero imputation, two-way imputation, response function imputation) interact with two methods of…

Diagnostic assessment is currently an active research area in educational measurement. Literature related to diagnostic modeling has been in existence for several decades, but a great deal of research has been conducted within the last decade or so, especially within the last five years. The author summarizes the key components in the application…

The speeches presented at the second national conference on testing deal with models for program evaluation, reporting of test results, minimum competency programs, and the role of state and federal government in educational testing. Various approaches to program evaluation, and its relationship to testing are described by Michael Scriven, Lee J.…

The National Education Association's Task Force on Testing has stated its opinion that standardized tests are overused. The task force suggests that the application of sampling techniques and a variety of alternatives to current testing practices would accomplish the same purposes. Representatives of the testing industry have indicated that the…

The author urges the adoption of take-home exams, whether individual or group efforts, subjective or objective in nature, as they lead to much more reflective thinking, problem solving, and other forms of data analysis than do standard one-period exams. (AN)

ICUE (Interactivity Centered Usability Evaluation) is an enhanced usability testing protocol created by the researcher. ICUE augments the facilitator's role for usability testing, and offers strategies in developing and presenting usability tasks during a testing session. ICUE was designed to address weaknesses found in the usability evaluation of…

This research evaluated the inter-rater reliability of the Performance Assessment for California Teachers (PACT). Multiple methods for estimating overall rater consistency include percent agreement and Cohen's Kappa (1960), which yielded discrepancies between rater agreement in terms of whether candidates passed or failed particular PACT rubrics.…