A large-scale and a small-scale simulation of the reallocation of students into and out of an originally-selected treatment group were performed. It was postulated that both the scores on a selection test and teacher ratings are measures of student needs in the Title I Evaluation and Reporting System (TIERS). In the norm-referenced model, three…

A study was conducted to explore the reliability and validity of three prominent procedures used in informal reading inventories (IRIs): (1) choosing a 95% word recognition accuracy standard for determining student instructional level, (2) arbitrarily selecting a passage to represent the difficulty level of a basal reader, and (3) employing…

Two approaches to criterion-referenced test construction are compared. Classical test theory is based on the practice of random sampling from a well-defined domain of test items; latent trait theory suggests that the difficulty of the items should be matched to the achievement level of the student. In addition to these two methods of test…

An aptitude test requiring 10-minutes' administration time was administered to high school students learning Forkner, Century 21, and Gregg shorthand for the purpose of determining test validity for different shorthand systems. Validity data were obtained from approximately 2000 students. Aptitude test reliability ranged from KR20=0.88 to 0.90.…

This paper discusses variables influencing written composition quality and how they can best be controlled to improve the reliability of assessment of writing ability. The study aimed to concentrate on the effects of different imposed time limits on student performance in written composition at grade 10 level using methods of generalizability…

This fifty item multiple choice test was developed by Portland Public Schools, Maine, to assess middle school students' understanding of the concepts presented in the "Responsibility" unit of the "Law in a Free Society" materials published by the California Bar Association. These materials deal with eight concepts for…

An area of current concern is that of the advantages and disadvantages of measuring writing proficiency directly via writing samples, and indirectly via objective tests. Much research has been completed documenting the correlation between direct and indirect measures. However, there had not yet been a systematic and detailed conceptual analysis…

This paper reports upon the evaluation and implementation of a 30-item Likert-type rating scale for teachers to use in assessing children's behaviors within preschool classrooms. The Preschool Observation Scale (POS) was developed to evaluate programs of the Mt. Druitt Early Childhood Project, North Ryde, Australia. Items were constructed on the…

The Carroll County (Georgia) Competency-Based Teacher Certification Project developed a measure of teacher effectiveness, the 341-item Georgia Assessment of Teacher Effectiveness, based upon five previously published classroom observation systems. Three concerns were drawn from the development of this instrument: (1) the reduction of observational…

Formulas are presented for decision reliability and for classification validity for mastery/nonmastery decisions based on criterion referenced tests. Two item parameters are used: the probability of a master answering an item correctly, and the probability of a nonmaster answering an item incorrectly. The theory explores the relationships of…

The reliability and validity of three measures of infant temperament were compared in this study. The measures included the revised Carey (1978) Infant Temperament Questionnaire, a version of the Bayley (1969) Infant Behavior Record revised for completion by the parent, and a modified version of Buss and Plomin's (1975) EASI, an acronym standing…

A set of procedures were developed for evaluating the State Capacity Building Programs; (SCBP), state projects for increasing facilities for the dissemination of information related to education. Six scales were developed, based on questionnaire items, to evaluate the following six facets of state information-dissemination systems: comprehensive…

The viewpoint is expressed that adding to test reliability by either selecting a more homogeneous set of items, restricting the range of item difficulty as closely as possible to the most efficient level, or increasing the number of items will not add to test validity and that there is considerable danger that efforts to increase reliability may…

Multiple matrix sampling is a sampling design in which both test items and examinees are randomly sampled from their respective populations. This study was designed to develop and assess a method for computing an estimate of a correlation coefficient when a multiple matrix sampling design is used. The examinee populations included 212 third-grade…

The construct of spatial ability is discussed and it is suggested that some widely used and cited tests that are called spatial ability tests may not be valid measures of that ability. Instead, their items may be solved using mental processes that are clearly analytical and not spatial in nature. Four studies involving the analysis of subjects'…