Technical documentation for educational tests focuses primarily on properties of individual scores at single points in time. Reliability, standard errors of measurement, item parameter estimates, fit statistics, and linking constants are standard technical features that external stakeholders use to evaluate items and individual scale scores.…

The framework and tools used for classroom assessment can have significant impacts on teacher practices and student achievement. Getting assessment right is an important component in creating positive learning experiences and academic success. Recent government reports (e.g., United States, Australia) call for the development of systems that use…

The present study aimed to represent the innovative assessments that support students' learning in STEM education through using the integrative framework for Cognitive Diagnostic Modeling (CDM). This framework is based on three components, cognition, observation, and interpretation (National Research Council, 2001). Specifically, this dissertation…

Just like all the high-stakes tests that determine students' futures nowadays, The Chorizo Test is a standardized test rooted in the culture of the test makers. It was originally created to be used with students in teacher training programs to sensitize them to the pitfalls inherent in standardized pencil-and-paper tests, such as linguistic bias…

When comparing data derived from tests or questionnaires in cross-national studies, researchers commonly assume measurement invariance in their underlying scaling models. However, different cultural contexts, languages, and curricula can have powerful effects on how students respond in different countries. This article illustrates how the…

Presents critical analysis of an earlier article, and argues that, although the validity of the High/Low distinction is questionable, it is possible for practical testing purposes to obtain reliable judgments from properly selected and trained judges. (seven references) (GLR)

When item response data do not satisfy the unidimensionality assumption, multidimensional item response theory (MIRT) should be used to model the item-examinee interaction. This article presents and discusses MIRT analyses designed to give better insight into what individual items are measuring. (SLD)

The purpose of this report is to describe the development of a pool of mathematical problem-solving situations and a set of items for each situation which provides information about students' qualitatively different levels of reasoning ability as applied to that situation. For each problem-solving situation, a set of "structured…

A previously published discussion of the ACER "Australian Studies in School Performance" suggests that the performance of students constitutes a concern; however, it is possible to be encouraged by evidence from the study that 97% of 10 year olds and 99% of 14 year olds have mastered the abilities to understand simple written sentences.…

Although item bias statistics are widely recommended for use in test development and test analysis work, problems arise in their interpretation. The purpose of the present research was to evaluate the validity of logistic test models and computer simulation methods for providing a frame of reference for item bias statistic interpretations.…

Development of new scales from test items usually requires several hundred cases in each of the defined groups. Application of multivariate techniques to existing test scales also encounters such problems as multicolinearity, combining ipsative with normative measures and ordinal with equal interval scales, differential prediction, and…

This technical manual is presented to assist those using the Audit of Principal Effectiveness, an 80-statement evaluation instrument designed to determine teachers' perceptions of principals' effectiveness, allow principals to obtain feedback from teachers regarding strengths and weaknesses, and provide a useful tool for researchers studying…

This book presents the full array of assessment methods available to the classroom teacher in an interesting and engaging format, broadens the preservice and inservice teacher's understanding of related assessment issues, and places assessment in a meaningful context. The text, which was developed for an introductory course in classroom…

This material provides a discussion of the construction and analysis of tests prepared for classroom use by teachers. The initial discussion is concerned with the purposes of evaluation and the specification of objectives. This is followed by an examination of theoretical and practical considerations in planning a test. The material on test item…

A technology for domain or criterion referenced testing was developed to evaluate the Minnesota Mathematics and Science Teaching Project (MINNEMAST) in grades K-6. The venture was influenced by the low achievement of MINNEMAST students on standardized tests. After instructional objectives were selected and operationally defined, corresponding test…