This paper summarizes the steps that led to the development of new test purchaser qualification forms (TPQFs), with major emphasis on a form for an educational test publisher. Three separate research studies, conducted by the Test User Qualifications Working Group (TUQWG) of the Joint Committee on Testing Practices, constituted the research base…

Guidelines for test developers and users are provided to insure that construction and selection of test instruments are conducted fairly. In addition to development and selection, issues of interpretation of scores; provision of information to test takers; and prevention of test bias based on race, gender, or ethnicity are addressed. Twenty-one…

The author proposes a greater professional association role in establishing standards for quality assurance in testing. He presents his views as a test developer who dislikes the legal model for resolving professional issues. The use of publications and informational activities to make people aware of the professional standards and how they can be…

Item analysis procedures appropriate for domain-referenced classroom testing are described. A conceptual framework within which item statistics can be considered and promising statistics in light of this framework are presented. The sampling fluctuations of the more promising item statistics for sample sizes comparable to the typical classroom…

Although effective and efficient assessment procedures are crucial to the success of organizational training programs, the tests used for both student and program evaluation are often developed by instructional designers (IDS) and subject matter experts (SMEs) with little formal training in test development. This paper summarizes the major…

The Maryland State Department of Education issued a request for proposals to develop a score reporting system for the Maryland Functional Testing Program. RMC Research Corporation conducted a literature review of extant literature and developed a national survey of non-norm-referenced test score reporting practices. This comprehensive analysis of…

This paper proposes that instructional validity (i.e., the extent to which teachers actually teach the skills that are tested) should be part of the test development process. The development of a district-wide ninth-grade math exam for General Mathematics I (GMI) in the Charleston County School District, South Carolina, is used to illustrate how a…

This article reviews the Basic Achievement Skills Individual Screener (BASIS), an individually administered achievement battery that consists of skills tests in reading, mathematics, and spelling as well as an optional writing exercise. BASIS is found to be an effective and efficient means of assessing basic skills. (Author/EGS)

The Dallas Independent School District (DISD) is rapidly progressing from the position of having an assessment program that does not work to the position of having an assessment program that does work. The perception that assessment is separate from instruction has changed to a view of assessment as part of a four-stage model including planning,…

Microcomputer versions of three commonly used cognitive style measurement instruments are described and demonstrated: the Leveling-Sharpening House Test (LSHT) (Santostefano, 1964); Lowenfeld's Successive Impressions Test I (SIT-I) (1945); and the Group Embedded Figures Test (GEFT) (Witkin, Oltman, Ruskin, and Karp, 1971). At present, many…

Reviews new conceptions of cognitive and conative aptitude, learning, development, and achievement and their assessment. Argues that different purposes for educational assessment require different levels and models of assessment. Strongly suggests research on construct validity and teacher understanding and use of assessment. (FMW)

This manual explains how to construct a questionnaire. It is intended for the novice researcher who has little experience in questionnaire construction. The first seven chapters discuss the following seven stages in questionnaire development: (1) establishing the guiding questions; (2) operationalizing and clarifying the guiding questions; (3)…

The National Assessment of Educational Progress (NAEP) approach to developing assessments is described. NAEP will solicit views concerning assessment objectives and use the consensus approach. NAEP results can impact educational policy and school and classroom practices. Several policies have been adopted to provide improved information about…

This paper presents future interactions between curriculum and test content, particularly standardized achievement test content. Three topics are discussed in question-answer form. (1) Will standardized testing dictate the curriculum in the future? An analysis of major curriculum change indicates two changes in the past 25 years: a revolution…

This technical manual provides all major existing information about the technical characteristics of the Kentucky Instructional Results Information System (KIRIS). The assessment component of the Kentucky Education Reform Act Accountability System was in use between 1991-92 and 1993-94 and was referred to as Cycle One. Two sets of test…