This paper addresses the problem of whether two-dimensional solutions with different apparent meanings and different implied interpretations of the number-correct scale could be produced from the same test data set by simply shifting the orientation of the two-dimensional projection plane. An artificial data set of 3,000 response vectors and a…

After establishing a theoretical depiction of the domain of literature learning, a study developed test packages which examined: (1) the relationship among multiple choice, short open-ended, and long open-ended responses; (2) whether there would be differences according to the genres; (3) the relationship between literary and non-literary texts,…

The purpose of this study is to examine an option-weighting method as it affects pass-fail decisions in formative and summative evaluation of student achievement for instructional units, certification, advancement, licensure, admissions, placement, and selection. A database was constructed using high school achievement test data where a…

Current educational theories emphasize assessment as a vital part of teaching-learning process. Alternative assessment techniques aim to expose and promote the process of the learning rather than the final outcome. Concept mapping is a technique for representing conceptual knowledge and relationships between concepts in a graphical form. Requiring…

In an article published in the spring 2003 issue of "Harvard Educational Review", Roy Freedle stated that the SAT® is both culturally and statistically biased. Freedle proposed a solution to this bias, which involved using a half-test made up of the most difficult items culled from complete SAT examination. His claims, which garnered…

Possible integrated and independent tasks were pilot tested for the writing section of a new generation of TOEFL® (Test of English as a Foreign Language™) examination. This study examines the impact of various rating designs as well as the impact of the number of tasks and raters on the reliability of writing scores based on integrated and…

Two factors which may affect the ratings assigned to an essay test are investigated: (1) context effects; and (2) score level effects. Context effects exist in essay scoring if an essay is rated higher when preceded by poor quality essays than when preceded by high quality essays. A score level effect is defined as a change in the score (value)…

The Language Proficiency Interview's structure, administration, and rating scale are outlined by an officer of the organization that designed it (Educational Testing Service), and some common mistakes made in its administration are listed. The need for training in the test's administration is emphasized. Its application in the corporate situation…

Significant to a latent trait or item response theory analysis of a mental test is the determination of exactly what is being quantified. The following are practical problems to be considered in the formulation of a good theory: (1) deciding whether two tests measure the same trait or traits; (2) analyzing the relative contributions of a pair of…

To compare the different images of writing that different assessment methods produce, a study examined two formal writing assessments--holistic and the specially developed intra-subject paired comparison method (IPC)--of pre/post university freshman composition-course writing. The samples of writing were unrehearsed, 50 minute, in-class essays.…

Uses of the variety of scores generated by standardized achievement tests are discussed. Desirable characteristics of scales, raw score scales, percent of correct items, percentile ranks, grade equivalents, normal curve equivalents, and scale scores are considered. The various meanings and purposes of each type of score are discussed. It is…

The advantages and disadvantages of two common grading methods are presented, and from an analysis of the virtues and vices of these prototypic methods, a set of goals or criteria for grading systems is derived. Percentage and class-curve grading systems are discussed in detail. Criteria for grading systems include the following: obtain relevant…

A confirmatory factor analysis was used to determine the respective viability of factor structure models for the Wechsler Adult Intelligence Scale-Revised (WAIS-R) standardization data. The traditional verbal-performance split was compared to an alternative model proposed by Gutkin, Reynolds and Galvin. The confirmatory analysis indicated that the…

The initial stimulus for measuring the composition skills of students in the Des Moines (IA) Independent Community School District came in 1980-81 when the school board adopted a goal for the year which stated: "The district should have school programs that improve pupils' competency in written expression." The intent of the original…

Two validity studies of the College Board College-Level Examination Program (CLEP) Subject Examination in Elementary Computer Programming: Fortran IV determined that CLEP scores are appropriate for granting examination credit at the University of Texas at Austin. The standard-setting administration was in the spring of 1979, with a re-evaluation…