Social scientists have long agreed that satisficing behavior increases error and reduces the validity of survey data. There have been numerous reviews on detecting satisficing behavior, but preventing this behavior has received less attention. The current narrative review provides empirically supported guidance on preventing satisficing by…

Both the attenuation paradox of traditional test theory and the assumption of local independence in person-item response theory have caused problems in interpretation. This paper demonstrates that the two are related concepts, and, through this demonstration, both are clarified. It is demonstrated that the breakdown of local independence leads to…

The importance of using the standard error of measurement (SEm) in determining reliability in test scores is emphasized. The SEm is compared to the hypothetical true score for standardized tests, and procedures for calculation of the SEm are explained. (JDD)

Extended caution indices (ECI) specify the degree of confidence that can be placed in an individual's test score by analyzing patterns of item response. Among the most promising of such indices are the standardized ECIs. Contrary to the literature, several instances were found, in a previous study, of nonnormal distributions of ECIs with samples…

College teachers often use norm-referenced classroom tests which are too easy for distinguishing adequately among levels of student achievement, yet they are reluctant to adopt more difficult tests. We explored the basis for current practices concerning test difficulty through informal interviews and questionnaires completed by faculty members and…

This study is an attempt at a cohesive characterization of the concept of essay reliability. As such, it takes as a basic premise that previous and current practices in reporting reliability estimates for essay tests have certain shortcomings. The study provides an analysis of these shortcomings--partly to encourage a fuller understanding of the…

To show the difficulty of eliminating test bias and to develop a methodology for distinguishing between the effects of prior knowledge and of skill development on reading comprehension, 207 eighth grade students from rural and urban areas were administered an 18-question reading comprehension test. Quantitative and qualitative effects of prior…

Examines some of the problems in interpreting data from attitude measures when the dimensionality of the instrument and sources of heterogeneity in the population are ignored. Illustrates this point by describing the development of an instrument designed to measure children's attitude toward science-related activities. (TW)

In certain situations, grade equivalent scores are the most appropriate statistic available for reporting achievement test data. It is noted that testing practitioners have found that raw scores, normal curve equivalents, stanines, and standard scores are very useful. However, it is best to convert to either grade equivalents or percentiles before…

Standardized achievement and aptitude tests may be of very limited value in making placement or instructional decisions about bilingual students. The practice of categorizing standardized test scores by ethnic groups obscures the difficulties of administering and interpreting tests taken by bilinguals. Individuals who are bilingual have two…

A random sample of 113 members of the American Vocational Education Research Association (AVERA) was surveyed to obtain baseline information regarding AVERA members' perceptions of statistical significance tests. The Psychometrics Group Instrument was used to collect data from participants. Of those surveyed, 67% were male, 93% had earned a…

New developments in testing in the United Kingdom (UK) since 1965 are described. Standardized testing at the local level declined dramatically with the widespread introduction of comprehensive secondary education. However, in the late 1970's widespread local testing programs were re-introduced for the purposes of monitoring student progress,…

A variety of methods are used by the Austin (Texas) Independent School District to report the results of student achievement testing. These techniques were developed to alleviate some of the problems that occurred previously: (1) a school's average score represents very few of its students because large numbers of students score very high or very…

Linear and equipercentile equating conversions were developed for two forms of the Graduate Record Examinations (GRE) quantitative test and the verbal-plus-quantitative test. From a very large sample of students taking the GRE in October 1981, subpopulations were selected with respect to race, sex, field of study, and level of performance (defined…

This paper presents results of a study examining the relationship between the American Board of Surgery's In-Training Examination and its Qualifying Examination. 1982 Test scores on both examinations of 764 candidates in their fifth year of training as Chief Residents were analyzed. Descriptive statistics, correlations, and standard errors were…