A new variant of the standard method for estimating the accuracy of educational tests is examined. It is found that the estimates produced by the new method are essentially unbiased and that the typical sizes of the errors of the estimates approach their theoretical lower limit as size increases, though they are still noticably above it for small…

Assessing a high school's effectiveness is not straightforward. Comparing a school's standardized test scores to those of other schools is one approach to measuring effectiveness, but a major objection to this method is that students' test scores tend to be related to students' "socioeconomic" status--family household income, for…

The use of e-assessment in higher education is a relatively new educational practice that has been more frequently studied in recent years. This review aims to summarise some research on e-assessment, providing an overview based on articles from three well-established scientific journals. Focusing on research topics, settings for e-assessment and…

The fields of pattern recognition and machine learning are on a fundamental quest to design systems that can learn the way humans do. One important aspect of human intelligence that has so far not been given sufficient attention is the capability of humans to express when they are certain about a decision, or when they are not. Machine learning…

Effective and efficient measurement of the development of skill and knowledge, especially in domains of human activity that involve complex and challenging problems, is important with regard to workplace and academic performance. However, there has been little progress in the area of practical measurement and assessment, due in part to the lack of…

The purpose of the recently proposed "p[subscript rep]" statistic is to estimate the probability of concurrence, that is, the probability that a replicate experiment yields an effect of the same sign (Killeen, 2005a). The influential journal "Psychological Science" endorses "p[subscript rep]" and recommends its use…

The sense that replicability is an important aspect of empirical science led Killeen (2005a) to define "p[subscript rep]," the probability that a replication will result in an outcome in the same direction as that found in a current experiment. Since then, several authors have praised and criticized 'p[subscript rep]," culminating…

This comment offers three descriptions of "p[subscript rep]" that start with a frequentist account of confidence intervals, draw on R. A. Fisher's fiducial argument, and do not make Bayesian assumptions. Links are described among "p[subscript rep]," "p" values, and the probability a confidence interval will capture…

The authors reported findings from 3 studies examining the efficacy of Five Standards pedagogy in raising student achievement. Studies 1 and 2 were randomized designs; Study 3 was a quasi-experimental design. Samples included 53 teachers and 622 predominantly low-income Latino students in Grades 1-4. Studies assessed model fidelity with the…

Annual student testing may make it possible to measure the contributions to student achievement made by individual teachers. But would these "teacher value-added" measures help to improve student achievement? I consider the statistical validity, purposes, and costs of teacher value-added policies. Many of the key assumptions of teacher value added…

Daniel J. Bauer, winner of the Award for Distinguished Scientific Early Career Contributions to Psychology, is cited for the creative integration of sophisticated quantitative methods with empirical research in the psychological sciences. Bauer draws on his joint training as a developmental and quantitative psychologist to pursue the design,…

There has been a widely held belief that people with autism spectrum disorders lack empathy. This article examines the empathy imbalance hypothesis (EIH) of autism. According to this account, people with autism have a deficit of cognitive empathy but a surfeit of emotional empathy. The behavioral characteristics of autism might be generated by…

In education, artificial intelligence (AI) has not made much headway. In the one area where it would seem poised to lend the most benefit--assessment--the reliance on standardized tests, intensified by the demands of the No Child Left Behind Act of 2001, which holds schools accountable for whether students pass statewide exams, precludes its use.…

The bibliography includes a selective listing of books, microfiche, and reference materials on educational and psychological testing, including tests for special populations. Suggested subject headings are noted, and five general information sources listed. Seventy-seven references on particular tests are arranged alphabetically by author. (CL)

This report presents the results of a research and development effort for SpeechRater? Version 1.0 (v1.0), an automated scoring system for the spontaneous speech of English language learners used operationally in the Test of English as a Foreign Language™ (TOEFL®) Practice Online assessment (TPO). The report includes a summary of the validity…