Classical procedures for calculating the two indices of decision consistency (P and Kappa) for criterion-referenced tests require two testings on each child. Huynh, Peng, and Subkoviak have presented one-testing procedures for these indices. These indices can be estimated without any test administration using Ebel's estimates of the mean, standard…

Recounts the negative experiences two cities had with districtwide testing programs. (IRT)

This article presents views of proponents and opponents to standardized tests, isolates the major weakness of testing--questionable validity--and offers several recommendations for the betterment of test development and use. Some major misuses of tests include the following: (a) tests are at times administered with no clear purpose; (b) test…

Examines six areas of controversy surrounding testing--test validity, the role of affective objectives, criterion-referenced tests, test bias, IQ tests, and the effect of competition. (IRT)

Cross-referenced to instructional objectives defined in a previous publication, (Guidelines to Mathematics, K-6), the Wisconsin Mathematics Test can be used to measure achievement gains over a given year, or to detect student strengths and weaknesses, by correlating missed items with the objectives. It is also possible to compare results on a…

The proposed standard for judging proficiency test score reliability requires that the proportion of items passed for each objective assessed be a dependable estimate of the universe score for the domain strata established by the objective. Domain breadth is the focusing issue. Data from a field trial of the Tennessee Proficiency Test are analyzed…

Standardized achievement tests are often misused as indicators of a school's quality or effectiveness relative to other schools. This is an incorrect use because it ignores variation among schools in student abilities, family support of education, student mobility, and other factors. People also misuse tests because they impute to them more…

The Melbourne Music Evaluation Kit (MEK) was designed to aid teachers of first-year secondary-school music classes to select appropriate curriculum materials related to the music backgrounds of class members, as indicated by scores on the kit. Tests included in the kit are criterion- referenced and are used as a diagnostic tool to measure…

A discussion of evaluating informal logic competence centers on the identification of currently available tests and on a description of test theory, to aid in test selection. The following concepts in test theory are discussed: norm-referenced and criterion-referenced tests, true scores, reliability, validity, test selection and evaluation, test…

Perspectives on testing and grading are considered; and strategies, reference materials, and sample test items are presented. Attention is directed to specific impacts of testing and grading on students and teachers, purposes of testing and grading, and common complaints of students and teachers. Extra activities proposed for the teacher include…

The objectives of this booklet are to provide suggestions, procedures, and rules of thumb to aid the evaluator in using achievement tests in program evaluation. It also discusses some of the theories underlying the procedures for developing and selecting achievement tests and interpreting their results. Each of the six chapters offers advice on…

The Phoenix Union High School System has developed a basic skills assessment program in the areas of Reading and Mathematics. Procedures and considerations used in developing the system are discussed. Preliminary results on validity and reliability of the assessment instruments are presented. An example of criterion-referenced test development…

Discusses the movement toward authentic assessment, also called direct or performance assessment, as an alternative to multiple-choice, standardized, norm-referenced testing. Authentic testing involves assessment tasks that are real instances of extended criterion performances rather than proxies of actual learning goals. Questions use of…

In fall 1986, a study was conducted at Florence-Darlington Technical College (South Carolina) to measure the reliability and validity of the TEC-MAT, a newly developed entrance test. The TEC-MAT instrument, a criterion-referenced test consisting of 100 items assessing numerical skills, was field tested among a group of entry-level freshmen already…

Investigations into item bias provide an empirical basis for the identification and elimination of test items which appear to measure different traits across populations or cultural groups. The Psychometric rationales for six approaches to the identification of biased test items are reviewed: (1) Transformed item difficulties: within-group…