Concern for enhancing construct validity of vocational interest measures provides a focus for scale construction quite distinct from that derived from a criterion-referenced strategy: Construct-oriented measurement implies: (1) substantive definitions of dimensions; (2) concern for internal consistency reliability, as well as generalizability; (3)…

The Assessment Resource Center (ARC) at Florida State University provides computer assisted testing (CAT) for approximately 4,000 students each term. Computer capabilities permit a small proctoring staff to administer tests simultaneously to large numbers of students. Programs provide immediate feedback for students and generate a variety of…

The purposes of this study were to examine the reliability and validity of a basal reading series mastery test, and to explore the appropriateness and usefulness of two strategies for investigating the reliability and validity of criterion-referenced tests. Subjects were 47 sixth graders, who were tested on the SRA Reading Achievement Test, the…

The purpose of this study was to examine the reliability and validity of a basal reading series mastery test. Subjects were 47 fifth graders, who were tested on the SRA Reading Achievement Test, the Ginn 720 End-of-level 11 Mastery Test (MT), and the Word Reading Test. A subgroup of 22 children was tested a second time on the MT. Traditional…

The purpose of this study was to examine the reliability and validity of a basal reading series mastery test. Subjects were 25 fourth graders, who were tested once on the SRA Reading Achievement Test, twice on the Scott-Foresman End-of-Book 9 Criterion-referenced Test (CRT), and once on the Word Reading Test. Traditional psychometric correlational…

The purpose of this study was to examine the reliability and validity of a basal reading series mastery test. Subjects were 21 fourth graders, who were tested once on the SRA Reading Achievement Test, twice on the Holt Basic Reading Series Management Program Level 13 Test (MPLT), and once on the Word Reading Test. Traditional psychometric…

Provides an alternative analysis of the reliability associated with the van Hiele Geometry Test based on the assumption that the norm-referenced reliability coefficients provided by the developers were inappropriate. Discusses the agreement coefficient and the kappa coefficient. (YP)

This paper presents an evaluation of Army job training development and testing practices, with a focus on Advanced Individual Testing. Information comes from intensive interviews with school instructors and from observations in the schools. Results indicate that some aspects of the Instructional Systems Development (ISD) model have been…

The Carleton Academic English Language (CAEL) Assessment is a criterion-referenced test developed at Carleton University (Canada). It combines logic of performance testing with ethics of gradual admission, i.e., that limited-English-speaking students should be allowed to begin limited academic study in English, based on language proficiency and…

The reliability of criterion referenced tests, which are often used to evaluate health education programs, may be conceptualized in different ways. Classical conceptualizations of test reliability have limited usefulness when applied to health-related criterion referenced tests. When a cutting score is set, test reliability can be represented as…

The feasibility of creating an item bank from a teacher-made test was examined in two comparable sections of a graduate-level introductory measurement course. The 67-item midterm examination contained multiple-choice and master matching items, which required higher level cognitive processes such as application and analysis. The feasibility of…

Locally developed occupational tests were administered to 16- and 17-year-olds in a government-sponsored vocational education program in the United Kingdom over a six-month period in 1984. Job skills were tested in two occupational areas: use of a micrometer and invoice completion. Some performance tests were designed by researchers and some by…

Test item selection techniques based on traditional item analysis methods were compared to techniques based on item response theory. The consistency of mastery classifications in criterion referenced reading tests was examined. Pretest and posttest data were available for 945 first and second grade students and for 1796 fourth to sixth grade…

The purpose of this study was to (1) develop and validate criterion-referenced tests to measure science knowledge of students who finished the fifth grade, as well as those who finished the three cycles of the General Education and (2) to assess the performance on these tests of a national, random sample of fourth-, sixth-, seventh-, and…

Teacher-made mastery tests were administered in a classroom-sized sample to study their decision consistency. Decision-consistency of criterion-referenced tests is usually defined in terms of the proportion of examinees who are classified in the same way after two test administrations. Single-administration estimates of decision consistency were…