The vast majority of measures have, at their core, a purpose of personal and social change. If test developers and users want measures to have personal and social consequences and impact, then it is critical to consider the consequences and side effects of measurement in the validation process itself. The consequential basis of test interpretation…

In 2006, C. F. Bond Jr. and B. M. DePaulo provided a meta-analysis of means and concluded that average lie detection accuracy was significantly greater than chance for most people. Now, they have presented an analysis of standard deviations (C. F. Bond Jr. & B. M. DePaulo, 2008), claiming that there are no reliable individual differences in lie…

In this comment on C. F. Bond and B. M. DePaulo, the authors raise methodological concerns about the approach used to analyze the data. The authors suggest further refinement of the procedures used, and they compare the approach taken by Bond and DePaulo with standard methods for meta-analysis. (Contains 1 table and 2 figures.)

People can use a variety of different strategies to perform tasks and these strategies all have two characteristics in common. First, they can be evaluated in comparison with either an absolute or a relative standard. Second, they can be used at varying levels of consistency. In the present article, the authors develop a general theory of task…

The unique conceptual framework and language of generalizability theory are presented. While this chapter is relevant to any area in which generalizability theory is applicable, it emphasizes evaluation research, and most examples come from that area. (Author/PN)

Considers issues surrounding the use of differentiated examinations. Discusses how differentiation may be provided, the wording of questions, and how marks should be given. Highlights some pitfalls of using this approach. Concludes that, although differentiated examinations are possible, they will not always meet the needs of the end range of test…

Notes that significantly different results frequently exist between tests that purport to measure the same skill when the same child is tested on both instruments. Considers discrepancies related to examinee, examiner, examinee-examiner interactions, environment, and psychometric characteristics of the tests employed. Cites 10 major psychometric…

Statistical significance and "abnormality" have been used as criteria for the evaluation of intra-individual subtest score differences. Shortcomings of these criteria are identified, and improved estimates of the true score differences are suggested. The applicability of the abnormality criterion to these improved estimates is reviewed.…

This report is the third in a series of research projects concerning abilities and performance processes, particularly in school mathematics. A theoretical scrutiny of traditional psychometric testing, cognitive processes, their interrelationships, and an empirical application of the theoretical considerations on the level of junior secondary…

Shows why the role of intelligence in everyday life is often underestimated, drawing an analogy that examines outcomes of life as analogs of items within classical test theory. In addition, a population-IQ model is explained that tests for the pooled effects of intelligence at individual, individual context, and population levels. (SLD)

Measures of consistency and completeness of order relations derived from test-type data are proposed. The measures are generalized to apply to incomplete data such as tailored testing. The measures are based on consideration of the items-plus-persons by items-plus-persons matrix as an adjacency matrix in which a 1 means that the row element…

Reviews the research that has tested the "goodness of fit" model of temperament-context relations and proposes that research aimed at testing this model should examine how inter-individual differences in interactions between children and their contexts over time establish correlations between individuals and their settings. (HOD)

Four tests were chosen for a study that investigated the hypothesis that individual differences in aural comprehension might anticipate individual differences in general information. A composite of eight subtest scores from the Test of General Information (TGI) was used as a measure of students' general knowledge. The Listening section of the…

Under given conditions, conventional testing and computer-generated repeatable testing (CGRT) are equally effective for estimating examinee ability; CGRT is more effective for estimating the mean ability level of a group and less effective for estimating ability differences among individuals. These conclusion are drawn from domain-referenced test…

The scientific concept of intelligence has been heavily influenced by the technology of measurement. The variables which can be measured have been made the operational definition of intelligence. This approach differs from a deductive approach, in which a theory of cognition in general is used to derive the sorts of measurements that must be taken…