Although peer nomination measures have been used by researchers for nearly a century, common methodological practices and rules of thumb (e.g., which variables to measure; use of limited vs. unlimited nomination methods) have continued to develop in recent decades. At the same time, other key aspects of the basic nomination procedure (e.g.,…

The University of Reading Learning Gain project is a three-year longitudinal project to test and evaluate a range of available methodologies and to draw conclusions on what might be the right combination of instruments for the measurement of Learning Gain in higher education. This paper analyses the validity of a measure of critical thinking…

This paper aims to present a critical analysis of the Year 1 Phonics Screening Check (PSC), with special focus on the relationship between the UK Department for Education's policy-making and the evidence considered in the process of developing and evaluating the PSC. The reports from the in-house Standards and Testing Agency and from commissioned…

The number of public school students who are English learners (ELs) has been increasing steadily in the United States. According to a report by Snyder, de Brey, and Dillow (2016), in the 2014-2015 school year, nearly 4.6 million students enrolled in Kindergarten through grade 12 (K-12) in U.S. schools were English learners, representing…

In the present investigation, the authors provide internal consistency reliabilities for Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV) subtest and Index discrepancy scores using the standardization sample as the data source. Reliabilities ranged from 0.55 to 0.88 for subtest discrepancy scores and 0.80 to 0.91 for Index discrepancy…

Cut scores are used in a variety of circumstances to aid in decision making through the establishment of a clear cut line between adjacent categories. Community colleges regularly use cut scores on placement tests to decide the appropriate course for each beginning student: the first college-level course or a developmental course, depending on…

There is an increasing interest in reporting subscores, both at examinee level and at aggregate levels. However, it is important to ensure reasonable subscore performance in terms of high reliability and validity to minimize incorrect instructional and remediation decisions. This article employs a statistical measure based on classical test theory…

Depression at the end of life is a common mental health issue with serious implications for quality of life and decision making. This study investigated the reliability and validity of one of the most frequently used measures of depression, the Hamilton Depression Rating Scale (HAM-D) in 422 patients with terminal cancer admitted to a palliative…

Psychometric issues arising from the use of minimum competency tests in local option states were examined in seven school districts. The effect of variability in reliability and difficulty level of subtests on the accuracy of decisions based on such tests is questioned, particularly as they affect mildly handicapped and marginal students.…

Generalizability theory is used to show that the assumption that reliability for groups is greater than that for persons (and that error variance for groups is less than that for persons) is not necessarily true. Examples are provided from course evaluation and performance test literature. (SLD)

Discusses the benefits and shortcomings of three systems for assessing risk factors affecting children: the Illinois CANTS 17B; the Washington Assessment of Risk Matrix; the Child at Risk Field System. Although these systems are used in 23 states, the lack of staff knowledgeable about human development and the uncertain reliability and validity of…

To address criticisms that the empirical literature on assessment of career decision making has tended to lack a theoretical base, the present study explored the relevance of a general theory of decision making to career decision making by assessing the psychometric properties of the Decision Making Inventory (DMI), designed to measure Johnson's…

Poor performance of medical students, residents, and faculty on a newly developed Inventory of Cognitive Biases in Medicine, suggests that cognitive biases detract from reliance on logical and statistical strategies in medical decision making. The test shows promise for use in instructional and research efforts to reduce such bias. (Author/MSE)

In the light of reports of bias, the present study investigated the hypothesis that administrative educational decisions assisted by Decision Support Systems (DSS) are characterized by different pedagogical and organizational orientation than decisions made without computer assistance. One hundred and ten high school teachers were asked to suggest…

The design and reliability testing of two instruments--the Macro Argumentation Structure (MARS) and the Coalition forming and Dominance (CODOM)--to assess the deliberation process (argumentation and interaction) during curriculum conferences/decision making are reported. The study was conducted at the Department of Education of the University of…