Preliminary data was gathered to guide subsequent research that will shape training procedures and scoring practice for performance assessment activities that integrate multiple content areas. Content area integration is a key feature of many of the tasks in the Maryland School Performance Assessment Program (MSPAP), a large-scale assessment of…

A study was conducted to provide information for setting two separate standards, the accuracy score and the documentation score, for the Praxis III: Classroom Performance Assessment (Praxis III). Praxis III is intended for making instructional and licensing decisions about beginning teachers. This standard-setting study was a person-judgment…

This digest presents a list of recommendations for writing multiple-choice test items, based on psychometrics and logical deduction. Questions should ask more than mere knowledge of facts and should not contain superfluous information as an introduction to the question. Each question should focus on some specific aspect of the course, and the item…

Classical test theory, item response theory, and generalizability theory all treat the abilities to be measured as continuous variables, and the items of a test as independent probes of underlying continua. These models are well-suited to measuring the broad, diffuse traits of traditional differential psychology, but not for measuring the outcomes…

In the 1995-96 school year, the Memphis (Tennessee) City Schools released standards for student performance in seven content areas and began laying the foundation for a standards-based curriculum and assessment system. The steps taken to develop and implement this project are outlined as follows: (1) defining the objectives and the project scope;…

The reasoning skills tapped by the analytical measure of the Graduate Record Examinations were studied by examining how performance on its constituent type items relate to alternative criteria. Another objective was to ascertain the extent to which additional information on examinees' analytical skills might be obtained from further analyses of…

The design, administration, scoring, and results of the 1993 New York State Correctional Captain Examination are described. The examination was administered to 405 candidates. As in previous Sergeant and Lieutenant examinations, candidates also completed latent image written simulation problems and open/closed book multiple choice test components.…

This book contrasts non-Soviet approaches to language testing and provides definitions from four Soviet language test experts. The role of foreign language teaching, the function of tests, and theoretical problems are discussed, with considerable focus on communicative competence. The book discusses test standardization and classification and…

This guide is designed to help teachers create test items that measure a variety of higher level thinking abilities. Part One, "Foundations for Item Writing," provides a context for item writing. Chapter 1 provides an overview of the book and defines basic concepts, principles, and terminology. Chapter 2 integrates research literature to…

The Institutional Self-Assessment Measure (ISAM) is presented, which was designed to aid local agency program managers and staff members in planning and improving implementation of competency-based education (CBE) programs. It is a structured tool to be used with the support of a trained ISAM facilitator to enhance communication among staff…

The New Standards Project is a partnership of 17 states and 6 major school districts that have joined to develop alternative approaches to setting educational standards and assessing student achievement. In the New Standards Project plan, formal standard setting occurs through a process of public examination of student work products on pilot…

The development and validation of the General Management In-Basket (GMIB) is described. The GMIB is a theory-based generic in-basket simulation, designed to assess supervisory and management skills independent of any job classification. Three of the 15 in-basket items in the GMIB are critical and are scored on a 0-5 scale. The remaining 12 items…

Although many sources have discounted the likelihood of grade inflation resulting from instructors trying to "buy" better student ratings of instruction, many faculty members still believe that there is widespread manipulation of grades. This study involving 28,629 undergraduates over a 6-year period found no relationship between…

This manual provides directions for administering, scoring, and interpreting the 44-item Change Facilitator Stages of Concern Questionnaire (CFSoCQ), which measures types of concerns that persons have in relation to their change facilitator role. Section 1 provides background information about earlier research (describing concerns, initial…

How data gathered through item response theory (IRT) analysis can be used to give immediate diagnostic information without a computer is explained. The Kidmap, developed by B. D. Wright and others (1980), provides clear information in a visual manner. Its major problem lies in the need for a computer and suitable software to construct a Kidmap.…