This article describes the development, initial validation, and psychometric evaluation of the mathematical modeling attitude scale (MMAS). Specifically, both qualitative and quantitative techniques were used to generate relevant items. The MMAS assesses K-12 teachers' attitude toward mathematical modeling and examines their experiences with…

This monograph provides an epistemological rational for the Accumulative Manifold Validation Analysis [also referred by the acronym "AMOVA"] statistical methodology designed to test psychometric instruments. This form of inquiry is a form of mathematical optimization in the discipline of linear stochastic modelling. AMOVA is an in-depth…

Issues arising from difference scores with zero reliability that nevertheless allow a powerful test of change are discussed. Issues include the appropriateness of underlying statistical models for psychological data and the relationship between difference scores and power. Increases in reliability always increase power for a fixed effect size.…

A procedure for estimating the reliability of a factorially complex composite is considered. An application of its use with Scholastic Aptitude Test data is provided. (Author/JKS)

A response to comments on internal correlation for statistical analysis, as proposed by the present authors (1989), is provided. Focus is on issues raised by W. W. Rozeboom (1989). Comments by J. H. Schuenemeyer (1989) and R. Bargmann (1989) are briefly considered. (TJH)

The relation between the power of a significance test in a block design with correlated measurements and the reliability of the measuring instrument is analyzed in terms of the components of variance entering the reliability coefficient and the noncentrality parameter. (Author/LMO)

The internal correlation--a measure of dependency in a set of variables--is discussed and generalized. Applications of the internal correlation coefficient and its generalizations are given for several data-analytic situations. The internal correlation is illustrated and the concept is expanded to a series of additional indices. (TJH)

Use of internal correlation for statistical analysis--proposed by G. W. Joe and J. L. Mendoza (1989)--is discussed. Focus is on the "content" question (what this application can do with the information that statistics contain) and the "eloquence" question (the advantages of this means of encoding information over other means). (TJH)

The psychometric objections to using essays and other subjective tests for measurement can be overcome by a many-facet Rasch model. This model enables judge-awarded grades to be transformed from their arbitrary, local, non-linear rating scale form into linear measures with explicit generalizable meaning of specifiable reliability (standard error)…

It is shown that empirical mental test P - P plots are approximately equal to theoretical item-item curves, at least for long tests administered to many people. This result is important because it leads to (1) a distribution free method for estimating points on item-item curves; (2) a general method for defining estimates of item parameters; and…

Three frequently used response formats are compared via analysis of covariance structures. The cumulative results based on four data sets provided evidence inconsistent with previous research suggesting that these formats are interchangeable. The semantic-differential format is most preferred while in most cases the Stapel format is least…

A method is proposed for sequential evaluation of reliability of psychometric instruments. Sample size is unfixed; a test statistic is computed after each person is sampled and a decision is made in each stage of the sampling process. Results from a series of Monte-Carlo experiments establish the method's efficiency. (SLD)

This document contains three papers from the Methodology Project of the Center for the Study of Evaluation. Methods for characterizing test accuracy are reported in the first two papers. "Bounds on the K Out of N Reliability of a Test, and an Exact Test for Hierarchically Related Items" describes and illustrates how an extension of a…

The Mastery-Learning test model is extended. Methods for estimating prior probabilities are described. The use of an adjustment matrix to transform a probability of mastery measure and empirical methods for estimating adjustment matrix parameters are derived. Adjustment matrices are interpreted as indicators of instructional effectiveness and as…

Tailored testing procedures for achievement testing were applied in a situation that failed to meet some of the specifications generally considered to be necessary for tailored testing. Discrepancies from the appropriate conditions included the use of small samples for calibrating items, and the use of an item pool that was not designed to be…