Any examination that involves moderate to high stakes implications for examinees should be psychometrically sound and legally defensible. Currently, there are two broad and competing families of test theories that are used to score examination data. The majority of instructors outside the high-stakes testing arena rely on classical test theory…

This document describes the breadth of the research that the ETS (Educational Testing Service) Research & Development division is conducting in 2010. This portfolio will be updated in early 2011 to reflect changes to existing projects and new projects that were added after this document was completed. The research described in this portfolio falls…

In most judgmental methods for setting performance standards, content experts evaluate test items based on a conceptualization of a borderline examinee or a group of examinees. An alternative method is proposed by which judges evaluate items based on the degree of criticality regardless of content area. This classification of items serves to link…

An attempt was made to evaluate the standard error of equating (at the mean of the scores) in an ongoing testing program. The interest in estimating the empirical standard error of equating is occasioned by some discomfort with the error normally reported for test scores. Data used for this evaluation came from the Admissions Testing Program of…

The research leading to the decisions to revise the Graduate Record Examination Aptitude Test (GRE) (beginning in October 1981) is reviewed. The issues discussed include the format of the test (the timing of each section and the number of sections, the content of the sections--especially the analytical section), the scoring procedure for the GRE,…

This paper describes conventions in the scoring of classroom tests and of the achievement batteries used in school districts', testing programs in the U.S. The scales used for the Scholastic Aptitude Test and the American College Testing Program are described. Some new, criterion-referenced scales developed for state and national assessments are…

Standard-setting practices in states using the National Teachers Examination (NTE) were examined. Passing score-setting procedures, recommended study scores, passing scores established by the states, and the implications of the passing scores were studied. States have typically adopted standards lower than cut scores recommended by advisory…

This study evaluated agreement between expert system and human scores on 12 algebra word problems taken by Graduate Record Examinations (GRE) General Test examinees from a general sample of 285 and a study sample of 30. Problems were drawn from three content classes (rate x time, work, and interest) and presented in four constructed-response…

This plan presents the procedures to be followed in the administration of the Florida College-Level Academic Skills Test (CLAST) for the 1994-95 academic year. The document specifies the responsibilities of the Department of Education, the technical support contractor, and individual institutions. The plan does not include procedures needed in…

Effects of passage and item-scrambling on equipercentile and item-response theory equating were investigated using 2 scrambled versions of the American College Testing Program Assessment for approximately 25,000 examinees. Results indicate that using a base-form conversion table with a scrambled form affects the individual examinee level. (SLD)

This study compared the different modes of evaluation at work in Greece's secondary school graduation and university admission process. The goals of the study were (1) to provide background information regarding the contribution of in-school assessment scores and external examination scores to higher education admissions decisions, and (2) to…

The Defense Activity for Nontraditional Education Support (DANTES) Program is a testing service conducted by the Educational Testing Service for DANTES, an agency of the Department of Defense. DANTES' mission is to help service members obtain credit for knowledge and skills acquired through non-traditional educational experiences. Since World War…

This user handbook includes four main sections: (1) components of the American College Testing (ACT) Program Assessment; (2) ACT Assessment Reports and Data Services; (3) using ACT student data; and (4) ACT assessment participation. The components described are the four tests of educational development, the High School Course/Grade Information…

In developing countries, for the most part, traditional methods of selecting students for secondary schools, technical and vocational institutions, teacher training colleges, and universities are unable to ensure that the most capable applicants receive the limited opportunities available. To remedy this situation, the author has assembled and…