e-Assessment, in the form of tools and systems that deliver and administer multiple choice questions (MCQs), is used increasingly, raising the need for evaluation and validation of such systems. This research uses literature and a series of six empirical action research studies to develop an evaluation framework of categories and criteria called…

Before selecting any measurement instrument the test user should always determine what it is he wants to know. A new instrument, The Assessment of Career Development (ACD), attempts to assess students' knowledge about jobs. One must, however, determine whether the content of the ACD is similar to the content of the career information system the…

A distinction is made between program evaluation and project evaluation. The former is used to determine the effectiveness of a particular program or to compare programs. The latter is used in the initial stages of program development to define and monitor progress; to identify problems at an early stage; to record what is done and why; and to…

This paper reports the results of a survey conducted in the spring of l981 that was designed to collect and summarize guidelines on appropriate test use from the various organizations, agencies, and associations involved in standardized educational testing. The primary objective of the study was to learn how these various groups define the issues…

Fourteen criteria used to evaluate criterion referenced tests were assigned two sets of weights reflecting the characteristics of tests designed as a classroom resource or for program evaluation. Twenty eight currently available criterion referenced tests were rated against the criteria using each set of weights. A comparison of the scores…

A procedure for in-depth analysis of a limited number of tests being considered for selection by a school, district, project, or state personnel is described. This procedure involves listing the objectives that it would be desirable to measure determining the relative importance of each of these objectives, having "judges" match test items to…

As part of the development of a collection of criterion-referenced test reviews, a survey was conducted to determine the information needs of educators who select tests. Three aspects of test selection were emphasized: (1) factors affecting choices among available tests; (2) consumers' knowledge, beliefs, and attitudes about criterion referenced…

This study surveyed 53 master's level students in two tests and measurement classes to determine if and in what fashion they had been victimized by testing and evaluation. The purpose of this activity was to acquire personal data which could be used to both dramatize and formulate criteria for the construction of classroom tests. A majority of…

An analysis was made of quality ratings of elementary level standardized tests. Applying multidimensional scaling to intercorrelations of quality ratings, it was found that the criterion of content and construct validity was a central element in the evaluation of elementary tests. In addition, several types of validity and reliability were found…

Characteristics which should be considered in reviewing any standardized reading test include validity, reliability, standardization sample, areas assessed by the test, type of response required by the child, individual versus group administration, time needed for administration, availability of equivalent forms, scoring options available,…

This survey investigated: (1) the extent that psychometric criteria are used in test selection; (2) the weight given to different types of psychometric information relative to other qualities of the test; and (3) possible reasons for differences among districts. Directors of testing offices, including members of the National Association of Test…

CAFETERIA-type rating systems, modeled after the one developed at Purdue University, allow the instructors being evaluated to select those items which their students will use in evaluating the instructors. Such computer-assisted systems allow the instructor to tailor the evaluation to the particular instructional strategies used. This study…

Because of the developmental characteristics of young children, the potential user of tests for educational evaluation needs to be keenly alert to the kinds of decisions which can be made on the basis of testing and to the limitations of testing when young children serve as subjects. The choice of a test to be used will depend on the type of…

A variety of terms related to test bias or test fairness have been used in a variety of ways, but in this document the "fair use of tests" is defined as equitable selection procedures by means of intact tests, and "test item bias" refers to the study of separate items with respect to the tests of which they are a part. Seven…

To permit local districts to exercise their option to use standardized tests for state-mandated evaluations, a test rating form was developed. A key concern was the percentage of state approved reading and mathematics skills measured by a test, rather than the test's value for other uses. Other content concerns were readability and cultural and…