Incidents affecting the implementation of large-scale testing programs are described to illustrate associated problems. Issues addressed include creation of test materials, preparation of answer documents, transportation of test materials, scoring and analysis of tests, and dissemination and utilization of test results. (TJH)

Methodology is suggested for several statistical procedures to detect polytomously scored items that function differently for two subgroups of examinees. The 3 methods are alternative ways of combining the data from 2 x "k" tables. Simulation results demonstrate the superiority of two of the methods, designated HW1 and HW3. (SLD)

Examined whether variations in construction and scoring (frequency, sum, average scores) of life events scale (stress measure) for adolescents yielded different outcomes. Findings from 1,740 high school students indicated that frequency of life events and their average intensity were distinct measures and of equal importance when assessing stress…

This study is the National Board of Medical Examiners exploration of content-based techniques (standard-setting techniques in which pass/fail decisions are based upon the performance of examinees in relation to test content). Two content-based techniques (Angoff and Ebel) and three methods of evaluating examinee performance were studied. (MLW)

Extended matching, a test item format used currently in medical licensing examinations, is described. Procedures for writing and reviewing such test items are outlined, test development and psychometric advantages are discussed, and issues in test administration and scoring are examined. The extended matching form is also seen as having uses for…

The Performance Assessment System (PAS) is a portfolio-assessment mechanism used to evaluate beginning teacher performance as a function of the teacher's approach and effectiveness at increasing student learning. The development, scoring, and use of the PAS are described. (SLD)

Sixth-grade teachers (n=26) estimated item performance for their students (724 total students) on a 50-item district-wide science test. Teachers were more accurate in estimating performance of the total group than of the borderline group, but in neither case was their accuracy high. Estimating proportion-correct values using the Angoff standard…

A study involving 105 sixth-graders examined three aspects of technical adequacy with respect to two general outcome measures in mathematics: the effects of aggregating scores and correcting for random guessing on reliability and validity and the extent to which the measures were sensitive to changes in performance. (Contains references.)…

Explores the development of performance-based assessments from the teacher's perspective. Describes the issues of relevance and representativeness within the context of a rubric designed to assess student development and performance of a rhythmic composition. Discusses three ways a component can be irrelevant, measuring proficiency, and…

Used a multitrait-multimethod approach to investigate the validity of scores on locally prepared performance assessments taken by 6,000 third and fourth graders in reading, language arts, and mathematics. A partial explanation for the lack of construct validity evidence for the performance assessment scores is the probable low reliability of…

Objective: To evaluate the Strengths and Difficulties Questionnaire in a U.S. national population sample of children and adolescents, develop normative scoring bands, and test the association of high-scoring groups with service contacts or use for mental health reasons. Method: An Americanized version of the Strengths and Difficulties…

If the organisms in a prairie ecosystem created a newspaper, what would it look like? What important news topics of the ecosystem would the organisms want to discuss? Imaginative and enthusiastic third-grade students were busy pondering these questions as they tried their hands at "ecosystem journalism." The class had recently completed…

The purpose of this study was to identify the factors that contributed to vocational rehabilitation assessment of earning capacity. Rehabilitation professionals who attended a national forensic rehabilitation conference were asked to rate the importance of 26 variables in development of opinions of earning capacity. Exploratory factor analysis…

Research into the technical adequacy of statewide alternate assessments is limited. In this study, the authors analyzed 2 years of data from one state's alternate assessment in written language in an attempt to validate current test score interpretations. More than 1,000 students were included in each year. Findings support the test's technical…

Ability estimates yielded by the one- (1PL), two- (2PL), and three-parameter (3PL) models and the nominal response model (NRM) were compared with the number-right (NR) scoring model using items not susceptible to test-wiseness (NTW) and items susceptible to the ID1 test-wiseness strategy. These items were contained in grade 12 diploma examinations…