Most training programs in education and psychology focus on classical test theory techniques for assessing score dependability. This paper discusses generalizability theory and explores its concepts using a small heuristic data set. Generalizability theory subsumes and extends classical test score theory. It is able to estimate the magnitude of…

This text was written to help the reader acquire a base of knowledge about classical psychometrics and to integrate new ideas into that framework of knowledge. The material is organized into five units: (1) introduction to measurement theory; (2) reliability; (3) validity; (4) item analysis in test development; and (5) test scoring and…

The 1986 scores from the Statewide Student Assessment Test-II, a minimum-competency test required for high school graduation in Florida, were placed on the scale of the 1984 scores from that test using five different equating procedures: (1) linear method; (2) Rasch model; (3) three-parameter item response theory (IRT)--concurrent method; (4)…

Six editions of Scholastic Aptitude Test-Mathematical (SAT-M) were factor analyzed using confirmatory and exploratory methods. Confirmatory factor analyses (using the LISREL VI program) were conducted on correlation matrices among item parcels--sums of scores on a small subset of items. Item parcels were constructed to yield correlation matrices…

The purpose of this paper is to compare the precision of direct and indirect measures of writing assessment using the test information functions from a graded response Item Response Theory (IRT) model. Subjects were 192 sophomore English students from a parochial high school in Wisconsin. Both direct and indirect measures of writing ability were…

In 1972, the Oregon State Department of Education changed its standards relating to graduation requirements after a survey revealed concern that the high school diploma had lost its credibility. Parkrose School District developed a goal-based curriculum and measurement program to meet the new requirements. From the program's inception, District…

This monograph is designed for educators who must make decisions about curriculum, instruction, and the training of teachers. Many important educational decisions are made based primarily, if not exclusively, on test scores. This reliance on test scores has evolved for a variety of reasons. This monograph starts with test scores as a given in…

Early National Teacher Examinations test-appraisal studies focused only on the extent to which the content covered on a test matched the content of teacher education curricula. Recently, there has been a shift in emphasis from adequacy-of-preparation, which is now seen by many as irrelevant to establishing the appropriateness of a teacher…

Comparisons were made of three Angoff Design V linear equating methods (two forms equated to a common test, two forms predicted by a common test, or two forms used to predict a common test) and Tucker's and R. Levine's linear methods, under common item linear equating with non-equivalent populations. Forms of a professional certification test…

These studies in test adequacy focus on two problems: procedures for estimating reliability, and techniques for identifying ineffective distractors. Fourteen papers are presented on recent advances in measuring achievement (a response to Molenaar); "an extension of the Dirichlet-multinomial model that allows true score and guessing to be…

Practical and technical aspects of language testing research are considered in 23 articles. Topical areas include: testing of general proficiency; the hypothesis of a single unitary factor accounting for reliable variance in tests; the structure of language proficiency; pros and cons of cloze testing; a new functional testing approach; and…

Educational and psychological measurement has been a main area of work for the Australian Council for Educational (ACER) since its inception. The theoretical and practical contributions of latent trait measurement and commentary on the relatively recent use of these models in Australia were the focus of a seminar celebrating the 50th anniversary…

A general approach is proposed for modeling the structure of a two-way contingency table, and for drawing inferences about the marginal and interaction effects, cell parameters, and conditional probabilities. The prior distribution expresses uncertainty in a simple reduced model, in particular the independence model. The posterior estimates of the…

Presented is an investigation of the item and factor characteristics which make up Forms 8, 9, and 10 of the Armed Services Vocational Aptitude Battery (ASVAB). Data on the ASVAB forms were collected from mulitary enlistment applications at 20 Armed Forces Examining and Entrance Stations. Item and factor analyses were conducted on samples equated…

Interest inventories have been used extensively in high schools and universities to help students make career choices. To determine whether interest inventories aid students with their career development toward their college major and occupational choice, students were assigned to one of six interest inventory groups: Strong-Campbell (N=44); Kuder…