When comparing data derived from tests or questionnaires in cross-national studies, researchers commonly assume measurement invariance in their underlying scaling models. However, different cultural contexts, languages, and curricula can have powerful effects on how students respond in different countries. This article illustrates how the…

This essay argues that reliability should be reconceptualized in a way that reflects the importance of the theoretical expectations of the test specialist and the learning and problem solving of the test takers. It is time to characterize clearly the substantive theoretical framework supporting reliability studies and the technical evaluation of…

There is evidence that pre-tests can have orienting and motivational and teaching functions - in addition to the sought-for testing function. There is also evidence that these additional functions can be either general or specific. The present paper contributes to the ongoing debate by discussing the issues involved in the context of a series of…

After establishing a theoretical depiction of the domain of literature learning, a study developed test packages which examined: (1) the relationship among multiple choice, short open-ended, and long open-ended responses; (2) whether there would be differences according to the genres; (3) the relationship between literary and non-literary texts,…

Describes five propositions concerning classroom assessment. Uses propositions to review seven conference papers. Propositions refer to the following: nature of achievement; student information necessary to interpret assessments; tension between need to describe and need to praise; distinction between formal and informal assessment; and need for…

A quality control review of Connecticut's Sustained Effects studies was undertaken by the Chapter 1 Evaluation Technical Assistance Center (TAC) operated by RMC Research Corporation. Nineteen Connecticut school districts had selected from among four basic evaluation designs in implementing the Chapter 1 Sustained Effects requirement during 1982 to…

The first volume of a program to increase the academic growth of preschool and primary grade children through the utilization of brain hemisphere research, this manual outlines brain dominance theory and provides two instruments for assessing students' preferred style of learning. Material is provided in eight sections. Section 1 introduces the…

Argues that slide tests effectively evaluate students' understanding of geographic concepts. Discusses the purpose of using slides and outlines procedures for testing. Considers the qualitative results of three formal examinations and areas of visual confusion or misinterpretation; suggests improvements. Examines implications of computers for…

A collection of articles related to testing instruments of the National Teacher Examinations (NTE) are reviewed. The report has been organized into four sections. The first discusses briefly the background and purposes of the NTE and the hazards of combining data on these tests in research studies. The second section is concerned with articles…

The assumption that reliability is a necessary but insufficient condition for validity in assessment is challenged by exploring a dialectic between psychometric and hermeneutic approaches to drawing and warranting interpretations of human products of performance. Hermeneutic alternatives for epistemological and ethical purposes expand the range of…

This paper provides a theoretical discussion of educational program evaluation. Psychometric theory and developmental psychology are compared as they pertain to the testing of children. The nature of change in childhood makes it necessary to examine the assumptions and goals related to the testing of children as a means of evaluating educational…

A study was conducted to review the concept of validity in the context of vocational education and training (VET) in Australia. The study included a review of literature, case studies, presentation of key findings, and recommendation of a tool to guide assessors. An eight-faceted approach to validity, based on Nitko, was developed, with each…