This discussion of validation procedures for learning hierarchies based on an analysis of a target skill of instruction to aid in the instructional development process indicates that there is no catalog of validated hierarchies available for this use, and that the literature provides little assistance to the developer seeking practical procedures.…

Evaluation studies on educational questions attempt to provide answers in the form of conclusions or inferences which are derived from the information collected. Valid inferences are a result of careful research design for the study, and may be causal, descriptive, value-oriented, or probabilistic. Basic steps in designing an evaluation study are…

This paper is based on the premise that relatively little is known about how to improve validity in qualitative research and less is known about how to estimate validity in studies conducted by others. The purpose of the study was to describe the conceptualization of validity in qualitative inquiry to determine how it was used by the author of a…

The central idea in building and maintaining an item bank is to calibrate all the items onto a "common variable." The arithmetic involved in the calibration process is presented. It is recommended that an analysis of fit be done in every application to verify that the estimates of item difficulties are in fact sample-free. These…

Describes an attempt to construct an ESL dictation test that would: (1) be appropriate for a wide range of ability, (2) be easy and fast to score, (3) consist of set items that would form both a unidimensional and cumulative scale, and (4) yield scores that would be directly interpretable with respect to specified levels of English proficiency.…

The paper presents 12 steps in developing and validating criterion referenced tests (CRTs). The author emphasizes the need to closely examine the test's stated purpose and trace the test through the 12 steps in order to find CRTs that are useful rather than useless. Examples are given for each step: preparing or selecting objectives; developing…

Procedures for conducting functional level testing have been available for use by practitioners for some time. However, the Title I Evaluation and Reporting System (TIERS), developed in response to the educational amendments of 1974 to the Elementary and Secondary Education Act (ESEA), has provided the impetus for widespread adoption of this…

Eleven major models of learning styles are compared in terms of variables, appropriate populations, validity of instrumentation, and supporting research. Discussion considers: (1) Dunn and Dunn's Learning Style Inventory for grades 3 through 12 and Productivity Environmental Preference Survey for adults; (2) National Association of Secondary…

Only a limited number of single-subject studies exist in the literacy field, despite the upsurge of such studies in a wide variety of disciplines. The phrase "single-subject" refers not so much to the number of subjects, but to the way the data are analyzed: each subject's responses are examined individually; they are not averaged with…

Inspired by four recent decisions to change achievement tests used in the Austin Independent School District, the separate forms used and procedures followed have been combined into a systematic approach intended for use in future achievement test selections. A rating scale (Attachment 1) was developed to expedite a systematic comparison among…

This document is a training module designed to familiarize practicing school psychologists and school psychology students with the field of criterion-referenced measurement and recent developments within the field. The introduction gives reasons for the need for criterion-referenced testing as opposed to norm-referenced tests which include legal…

The Flesch readability index yields meaningful information about the responses of readers to texts. Because the formula is so simple, a group of English teachers wrote a program in BASIC that would count some obvious surface features of a text and calculate Flesch scores. Among the programing problems encountered were counting words (taking into…

The premise of this document is that trade instructors and incumbent workers can work together as a writing team to develop test items for vocational education. The development process used by the Vocational-Technical Education Consortium of States (V-TECS) is described as follows: (1) identify and validate a task list; (2) conduct task analysis;…

This paper provides an overview of standardized tests and a summary of important psychometric and test construction properties that educators must consider when they make critical evaluations of standardized tests. Sections of the paper concern: (1) basic characteristics of standardized tests; (2) differences between norm-referenced and…

In an effort to comply with bilingual instruction requirements, school districts throughout California will soon be involved in testing vast numbers of children to determine language proficiency and language dominance. Many language tests will require a child to repeat a sentence or a phrase in exactly the same manner that is stated by an examiner…