Political and legislative pressures have posed a number of measurement issues and challenges to the development of sound, valid voluntary national tests (VNTs). This paper focuses on what appear to be the most difficult technical issues related to the VNT proposed by President Clinton in 1997. Technical issues refer to psychometric issues, as…

The aim of this study was to explore a method of improving the objectivity, reliability, and efficiency of scoring performance assessments that involve constructed written responses. Millman (1997) has suggested an alternative to using model responses at each score category. The proposed strategy, hypothesized to increase scorer reliability and…

An important feature of recent large-scale performance assessments has been the reporting of pupil and school performance in terms of performance or proficiency categories. When an assessment uses such ordered categories as the primary means of reporting results, the natural way of reporting on the quality of the assessment is through the…

This study investigated the influence of role expectations, as defined by tenure status, on medical school faculty attitudes toward professional development activities. A total of 226 full-time faculty within a medical school completed a 15-item professional development goals questionnaire. The study found that full-time faculty perceptions of…

This document contains three papers from a symposium on leadership and executive development. "Leading and Managing in a Service Organization: An Examination of Line vs. Staff Effectiveness" (Allan H. Church, Janine Waclawski) presents an analysis of differences in managerial strengths and weaknesses between 45 line managers and 52 human resources…

Every year approximately 1,300 first-year students at the Rochester Institute of Technology complete a 50-minute placement essay during summer and fall orientations. The essays are scored holistically, and the students are placed into one of three levels of an English composition course. At the end of the 10-week quarter of instruction, students…

The Myers-Briggs Type Indicator (MBTI) is one of the most frequently used measures of personality. MBTI Form G and a self-descriptive adjectival checklist, the "Personal Preferences Self-Description Questionnaire" (PPSDQ), were administered to 191 college students. The four dimensions of personality measured by the MBTI are:…

Whether item response theory (IRT) is useful to the small-scale testing practitioner is examined. The stability of IRT item parameters is evaluated with respect to the classical item parameters (i.e., p-values, biserials) obtained from the same data set. Previous research investigating the effect of sample size on IRT parameter estimation has…

A study compared the nature and frequency of faults and errors in reference list entries and direct quotes selected from 78 articles in 8 issues of the "American Educational Research Journal" (AERJ) with authors sampled from 10 previously studied journals. All departures from the original (additions, omissions, or changes) were labeled as either a…

One approach to increasing our understanding of the rating process is to examine behavioral components of decision-making. Although observable rater behavior during appraisal is still removed from the actual contents of internal processing, these behavioral indices may provide important clues toward identifying determinants of rating success. To…

Much of what has developed in the testing of reading harkens back to the days of the "Cult of Efficiency" movement in education that can be largely attributed to Frederick Winslow Taylor. Taylor spent most of his productive years studying time and motion in an attempt to streamline industrial production so that people could work as…

Given the complexity of classroom reading observations, maintenance of measurement reliability is a concern to researchers. Sources of variation contributing to the unreliability of many measurements may be either (1) lasting and specific, (2) lasting and general, (3) temporary and specific, or (4) temporary and general. Lasting-specific sources…

Research studies have pointed to a similarity between reading and listening that may imply that listening to writing is likely to be a useful means of evaluating it. Therefore a study was designed to determine the extent to which holistic scores assigned to student essays by readers correlate with holistic scores assigned to the same essays by…

The results of a newly developed Haitian-Creole oral proficiency test are presented. The test is administered in Haitian-Creole to Creole-speaking and limited-speaking Haitian-origin children at two educational levels: grades kindergarten through 3 and grades 4-6. The test is designed to assess the child's language proficiency in three linguistic…

The purpose of this paper is to present a 50-item instrument (Appendix B) designed to assess needs for elementary school substitutes. Its use may provide valuable information for inservice training of substitute teachers, the often neglected cadre of professional educators. A priori and a posteriori validation procedures are described. A factor…