The existence of criterion-referenced (CR) measurement is questioned in this paper. Despite beliefs that differences exist between two alternative forms of measurement, CR and Norm Referenced (NR), an analysis of philosophical and psychological descriptions of measurement, as well as a growing number of empirical studies, reveal that the common…

Written to assist future researchers in conducting cross-national studies of classroom behaviors, this study indicates a number of factors which may reduce the validity of comparisons made. It is based on an investigation which explored the feasibility of using the Activities Categories Instrument and the Flanders Interaction Analysis Categories…

The Third International Mathematics and Science Study (TIMSS) developed and administered tests and questionnaires in three student populations to document the quality of mathematics and science education in 45 participating countries. Study design, instrument development, and research procedures were achieved through a complex collaborative…

A review of the literature on a variety of issues related to testing vocabulary knowledge in a second language addresses these topics: problems in estimating vocabulary size, including the related questions of what constitutes a word, how a sample should be selected, and what are the criteria for knowing a word; sampling the basic and specialized…

The introduction of the trial state assessment program into the design of the 1990 National Assessment of Educational Progress (NAEP) raises questions about differences across states in sampling and administration practices. In addition, questions about the general approach to comparing state data to national data need discussion. Subject areas…

This interim report of a pilot year impact study on evaluation methodology is part of a series of documents on the evaluation of Project Developmental Continuity, a Head Start demonstration program aimed at promoting educational and developmental continuity between children's Head Start and primary school experiences. This report deals with…

Project TALENT, the Equality of Educational Opportunity Survey, and the Base-Year Survey of the National Longitudinal Study tested national probability samples of American high school seniors in 1960, 1965, and 1972. This study is concerned with the feasibility of using these data for studying trends in educational attainment. Three separate…

The Anchor Test Study provides a method for translating a pupil's score on any one of eight widely used standardized reading tests for Grades 4, 5, and 6 to a corresponding score on any of the other seven tests, as well as furnishing new nationally representative norms for each of the eight tests. In addition, the Study presents new estimates of…

A study to compare the effects of reading achievement of informal and formal British infant schools is discussed. The informal school, for children from 5-8 years old, utilizes one or more of the following: integrated day, family or vertical grouping, open planning, and team teaching. The formal schools follow a prescribed curriculum and group…

A study conducted at one large research university compared electronic mail and telephones as methods for gathering survey data from undergraduate students. Problems associated with electronic-mail use include higher rate of socially undesirable activity among respondents and difficulty in identifying the target population. Implications for campus…

Research efforts have established that the Mantel-Haenszel procedure (MHP) is an effective method for detecting the presence of test items exhibiting differential item functioning (DIF). While the MHP has been advocated for situations where item response theory based methods may not be usable, recent findings have suggested that the performance of…

The Arlington, Washington, School District--a mostly rural district with enrollment of 2,790--conducted a survey of its public using both blanket mailing and random sampling procedures in order to compare the views of the total population with the views of the typically small percentage who mail back a questionnaire. The questionnaire contained 29…

A study explored which nonexperimental comparison group methods provide the most accurate estimates of the impacts of mandatory welfare-to-work programs and whether the best methods work well enough to substitute for random assignment experiments. Findings were compared for nonexperimental comparison groups and statistical adjustment procedures…

The Anchor Test Study provides a method for translating a pupil's score on any one of eight widely used standardized reading tests for Grades 4, 5, and 6 to a corresponding score of any of the other seven tests, as well as furnishing new nationally representative norms for each of the eight tests. In addition, the Study presents new estimates of…

A comprehensive assessment of the literacy proficiencies of Job Training Partnership Act (JTPA) and Employment Service/Unemployment Insurance (ES/UI) participants was conducted by the Department of Labor. The survey responses of a sample of 2,501 JTPA applicants and 3,277 ES/UI participants were scored, weighted, analyzed, and used to develop a…