The purpose of this article is to promote an increased awareness of the processes for setting cut-scores for complex performance assessments by (a) describing the Analytic Judgment Method (AJM) for setting cut-scores, and (b) critically evaluating the technical adequacy and practicability of the AJM by focusing on one investigation where the AJM…

In order to obtain concrete information to improve test writing, this study analyzes 13 achievement test drafts written by graduate teaching assistants, lecturers, and adjunct faculty teaching introductory and intermediate college Spanish. The analysis focuses on factors of test method and content likely to create variance in test performance…

This paper reviews the process a university foreign language department went through in developing a procedure to assess its curriculum using the ACTFL Proficiency Guidelines and, to a lesser extent, the National Standards, as guiding principles (National Standards, 1996). This procedure included a noncredit workshop that met only once to inform…

In this paper we discuss a variety of writing, reading and assessment techniques used in an elementary problem-solving class for pre-service K-8 teachers at Western Oregon University. We share our experience in teaching problem-solving strategies through selection and creation of quality word problems, problem-solving assessment and the Oregon…

The College Board's SAT[R] data are used to illustrate how the score equity assessment (SEA) can help inform the program about equatability. SEA is used to examine whether the content change(s) to the revised new SAT result in differential linking functions across gender groups. Results of population sensitivity analyses are reported on the…

This paper examines the problem of studying and comparing student software designs. We propose semantic categorization as a way to organize widely varying data items. We describe how this was used to organize a particular multi-national, multi-institutional dataset, and present the results of this analysis: most students are unable to effectively…

This is a report of an experimental study that focused on adjudicating the art portfolios of secondary art students assessed in both actual and digital forms in order to determine whether art teachers evaluate actual works of art in students' portfolios differently than digital copies of them. The study participants included 178 students of 29…

This study examined the use of rubrics in scoring a performance-based assessment. After receiving a health lesson of ways to have a healthy brain, fifth grade students were given an assignment to illustrate and write a booklet that demonstrated their knowledge of the topic. From students' responses the researchers constructed four sample papers…

Purpose: This study examined the usefulness of the Nonword Repetition Test (NRT; C. Dollaghan & T. F. Campbell, 1998) with 4-year-old children and the relationship among the NRT, language, and other aspects of mental processing. Method: The NRT was administered to 64 children at 4 years of age; 44 had a history of typical language development…

Content analysis scales apply rigorous measurement to verbal communications and make possible the quantification of text in counseling research. The limitations of the Origin and Pawn Scales (M. T. Westbrook & L. L. Viney, 1980), the Positive Affect Scale (M. T. Westbrook, 1976), the Content Analysis Scales of Psychosocial Maturity (CASPM; L.…

"Differentiating Instruction With Menus Grades 3-5" offers teachers everything they need to create a student-centered learning environment based on choice. Addressing the four main subject areas (language arts, math, science, and social studies) and the major concepts taught within these areas, these books provide a number of different types of…

In 2003, a trial National Assessment of Educational Progress (NAEP) mathematics assessment was administered in Spanish to public school students at grades 4 and 8 in Puerto Rico. Based on preliminary analyses of the 2003 data, changes were made in administration and translation procedures for the 2005 NAEP administration in Puerto Rico. This…

It is important to be able to describe instructional practices accurately in order to support research on "what works" in education and professional development as a basis for efforts to improve practice. This report describes a project to develop procedures for characterizing classroom practices in mathematics and science on the …

Secondary vocational-technical education programs in Mississippi are faced with many challenges resulting from sweeping educational reforms at the national and state levels. Schools and teachers are increasingly being held accountable for providing true learning activities to every student in the classroom. This accountability is measured through…

Secondary vocational-technical education programs in Mississippi are faced with many challenges resulting from sweeping educational reforms at the national and state levels. Schools and teachers are increasingly being held accountable for providing true learning activities to every student in the classroom. This accountability is measured through…