This article proposes that sampling design effects have potentially huge unrecognized impacts on the results reported by large-scale district and state assessments in the United States. When design effects are unrecognized and unaccounted for they lead to underestimating the sampling error in item and test statistics. Underestimating the sampling…

The purpose of this research was to investigate the predicting effect of high school students' metacognitive skills, exam anxiety and academic success levels upon their psychological well-being in a provincial center with a medium-scale population in Eastern Anatolian Region. The research group included totally 251 high school students including…

The DELPHI procedure requires respondents to reply to several questionnaire iterations with subsequent rounds containing previous round feedback. This study investigated the methodology (response rates, effects of feedback) and offered evidence that large-scale DELPHI surveys are not as advantageous as has previously been indicated. Suggestions…

A debate concerning specific issues and the general usefulness of the Rasch latent trait test model is continued. Methods of estimation, necessary sample size, and the applicability of the model are discussed. (JKS)

A model for the validation of standardized tests of academic achievement upon populations not represented in the samples used to standardize the tests is presented, and the results of a field testing of the model are described. The 1973 editions of the Stanford Achievement Test and the Test of Academic Skills were administered to a sample of…

Statements made in a previous article of this journal concerning the Rasch latent trait test model are questioned. Methods of estimation, necessary sample sizes, several formuli, and the general usefulness of the Rasch model are discussed. (JKS)

A logistic model was used to generate data to serve as a proxy for an immediate retest from item responses to a fourth grade standardized reading comprehension test of 45 items. Assuming that the actual test may be considered a pretest and the proxy data may be considered a retest, the effect of regression was investigated using a percentage of…

Procedures which are used by Harcourt, Brace Jovanovich, Inc., in developing achievement tests are described; these steps are suggested to be typical of major test publishers. A curricular analysis of fifth grade mathematics textbooks is presented, to illustrate the process which determines which skills and objectives are tested. The…

A sample of slightly over 1,500 students drawn from even-numbered grades in public schools of the U.S. Virgin Islands (USVI) were given the 1973 edition of the Stanford Achievement Test (grades 2, 4, 6, and 8) and the Test of Academic Skills (grades 10 and 12) in an attempt to assess student academic achievement in the basic skill areas of…

This study investigated the measurement integrity of the "Heart Smart" cognitive tests. Designed for fourth, fifth, and sixth graders, the tests measure health-related knowledge involving physiology, nutrition, exercise, and behavioral skills. The report presents tables of specifications, test floors and ranges, a demographic profile of…

Preliminary research testing the reliability and the validity of the "Thinking About My School" (TAMS) instrument is reported, and extensive data and analyses are included for the benefit of those who wish to do further evaluative work. Instructions for scoring and appropriate conditions for administering TAMS to students with low…

This partially annotated bibliography of journal articles, dissertations, convention papers, research reports, and a few books and unpublished manuscripts provides a comprehensive coverage of work on latent trait theory and practice. Documents are arranged alphabetically by author. The period covered ranges from the early 1950's to the present.…

Three approaches to the construction of achievement tests are compared: construct, operational, and empirical. The construct approach is based upon classical test theory and measures an abstract representation of the instructional objectives. The operational approach specifies instructional intent through instructional objectives, facet design,…

The development of the Student Selection Battery for the Beginning Teacher Evaluation Study is described. This battery, which measures reading and mathematics achievement in second and fifth grade students, will be used to select target students for the study of teaching effectiveness. Methodological considerations included: the limited amount of…