For use by those preparing statewide competency testing programs and those developing basic skills examinations at the postsecondary level, this paper provides guidelines for writing items for tests of basic reading skills. Following a discussion of how to choose appropriate items, how to word items, and how to select appropriate reading passages,…

A writing competency exam has been developed at a Vermont state college as a uniform method of judging attainment of a specified minimum standard for writing. The test was designed to meet four primary criteria: to judge student ability to create discourse, to yield specific evaluative information, to involve all academic divisions in test design…

This report summarizes findings on 26 National Teacher Examination specialty area tests provided by faculty reviewers from five Oregon institutions of higher education. Reviewers were asked to judge tests on the basis of: (1) whether students at the reviewer's institution would have the opportunity to acquire the knowledge measured in test items;…

A methodology for investigating the influence of correction-for-guessing directions and formula scoring on test performance was studied. Experts in the test content field used a judgmental item appraisal system to estimate the knowledge of the minimally competent candidate (MCC) and to predict those items that the MCC would omit on the test under…

The effects of feedback about the ratings of other judges on subsequent ratings using the Nedelsky method and the ability of judges to retain or eliminate options in a manner consistent with the judgments of minimally competent examinees were studied using data from a basic algebra examination administered to 227 college students in 1987. The…

The effect of increased writing or planning time on a test of basic college level writing ability was studied. The essay portion of the New Jersey College Basic Skills Placement Test was given to students in nine New Jersey public colleges and three New Jersey public high schools. Each student wrote two essays on two different topics. The first…

In this report four educators discuss the issues which they see to be most current in the fields of testing, measurement and evaluation. The first section discusses the mastery of basic skills, defined by minimum levels of competence. Factors such as accountability, social policy, instructional implications, and psychometric issues are brought to…

Minimum competency cut-off scores on a statistics exam were estimated under four conditions: the Angoff judging method with item data (n=20), and without data available (n=19); and the Modified Angoff method with (n=19), and without (n=19) item data available to judges. The Angoff method required free response percentage estimates (0-100) percent,…

The effectiveness of a model for determining a minimal cut-off score for criterion-referenced tests was examined. The model, based upon techniques presented originally by Nedelsky and by Angoff, was first used in conjunction with a multiple choice test developed for use in certifying school counselors in Georgia. A "knowledge estimation panel" was…

A procedure which employs a method of item substitution based on item difficulty is recommended for developing parallel criterion referenced test forms. This procedure is currently being used in the Florida functional literacy testing program and the Georgia teacher certification testing program. Reasons for developing parallel test forms involve…

After a brief review of recent research concerning teacher testing, this paper presents concrete examples of multiple-choice test items that assess more than teachers' minimal, basic knowledge. Specifically, multiple-choice test items used for the assessment of pedagogical content knowledge (C-P items) are contrasted with items used for the…

The licensure of public school personnel in Tennessee is a function of the State Department of Education (SDE). Additional requirements for this certification function were added by the Comprehensive Education Reform Act (Senate Bill Number 1) of the 1984 Tennessee General Assembly. The Act mandated that the SDE use tests to assess the competence…

Criteria for the selection of judges (evaluators) for setting item-based standards involved in tests for which cutting scores must be established are investigated. Focus is on cases in which test standards are based on specialists' judgments concerning the difficulty of test items in tests used to determine who will be awarded a diploma, admitted…