Reports the development and score validation of an instrument for measuring anxieties students experience in college chemistry laboratories. Factor analysis of scores from 361 college students shows that the developed Chemistry Laboratory Anxiety Instrument measures five constructs. Results from a second sample of 598 students show that scores on…

Examines criteria for choosing between test-centered and examinee-centered methods of standard setting in empirical terms and in terms of whether the method is consistent with the model of achievement underlying test design and interpretation and the assessment methods being used. Contains 35 references. (Author/SLD)

Describes the complexities and psychometric challenges facing efforts to devise standards-based performance assessments of teaching that are appropriate for teachers in a variety of contexts. Focuses on whether a general assessment of teaching practice can recognize culturally relevant pedagogy and suggests that such an assessment is possible.…

Proposes an algorithm that minimizes the asymptotic variance of the maximum-likelihood (ML) estimator of a linear combination of abilities of interest. The criterion results in a closed-form expression that is easy to evaluate. Also shows how the algorithm can be modified if the interest is in a test with a "simple ability structure."…

Compared four standard-setting procedures for an objective structure clinical examination (OSCE) in medical education. Applied Angoff, borderline, relative, and holistic procedures to the data used to establish a cutoff score for a pass/fail decision. The Angoff and borderline procedures gave similar results; however, the relative and holistic…

Developed a new instrument, the Basic Technology Competencies for Educators Inventory (BTCEI), using the responses of 437 undergraduate and graduate teacher education students. Results support the theoretical structure of the BTCEI. Scores for the nine domains had high internal consistency reliability and adequate stability reliability. (SLD)

Studied negative and positive responses of graduate students to items derived from the Rosenburg self-esteem test (1965). Rasch analysis reveals that to say "no" to a statement is not the equivalent of saying "yes" to its opposite, a finding with implications for test and survey construction. (SLD)

Confirmatory factor analysis was used to derive and cross-validate the factor structure of the Pain Response Inventory (PRI), a measure of children's coping responses to recurrent pain, with 688 school children, 120 children with abdominal pain, and 175 former abdominal pain patients. Results suggest that different health outcomes are predicted by…

The Obsessive-Compulsive Inventory (OCI), a new self-report measure for determining the diagnosis and severity of obsessive- compulsive disorder (OCD), was validated with 141 patients with OCD, 58 with social phobia, 44 with posttraumatic stress disorder, and 194 nonpatients. The OCI exhibited satisfactory reliability and validity with all four…

This paper describes the development and empirical investigation of two new paper-and-pencil measures of elementary cognitive tasks (PP ECTs). In three empirical studies involving 333 adults, the PP ECTs proved reliable. They were substantially correlated with other measures of psychometric intelligence and they displayed convergent validity with…

Whether a middle alternative in the response choices to a questionnaire influences the reliability and validity of survey responses was studied with 1,390 physicians, nurses, and midwives. Including a neutral option had little effect on overall reliability and validity, but allowed better coherence when items were considered globally. (SLD)

A Rasch-type analysis is presented for multiple-choice items in which one parameter is assigned to each distractor. Results of a small simulation study show that the parameter recovery of the distractor model is very satisfactory. Analysis of a real dataset shows that some items fit the Rasch model rather than the distractor model. (SLD)

Research on developing technology for large-scale performance assessments in science is reported briefly, and a conceptual framework is presented for defining, generating, and evaluating science performance assessments. Types of tasks are discussed, and the technical qualities of performance assessments are discussed in the context of…

Outlines each of the papers presented in this special section, describes difficulties the arguments posed, and raises questions that might be put to the author of each of these discussions of new assessment methods in mathematics. Implications for the technology for the development of performance assessments are discussed. (SLD)

Several recent studies are identified that used expert ratings of the job performance of certified professionals as a validation criterion. These studies showed a strong relationship between expert ratings and certification, but were susceptible to alternative interpretations due to design constraints. Inclusion of control constructs is presented…