Reliability methodology needs to evolve as validity has done into an argument supported by theory and empirical evidence. Nowhere is the inadequacy of current methods more visible than in classroom assessment. Reliability arguments would also permit additional methodologies for evidencing reliability in classrooms. It would liberalize methodology…

Although peer reviewing of writing is a way to create more writing opportunities in college and university settings, the validity and reliability of peer-generated grades are a major concern. This study investigated the validity and reliability of peer-generated writing grades of 708 students across sixteen different courses from four universities…

Universal design, applied to instructional delivery systems, can be a powerful way to promote greater access to information for a wide range of students. However, the assessment of this information is of equal importance. This article provides a brief review of current assessment practice in postsecondary settings, and explains how universally…

A behavioral assessment system for scoring the behaviors of parents and coaches at youth sports games is described within this paper. The Youth Sports Behavior Assessment System (YSBAS) contains nine behavioral categories describing behaviors commonly seen during youth sports. The developmental process of YSBAS and the observer-training program…

In educational research, characteristics of the learning environment are generally assessed by asking students to evaluate features of their lessons. The student ratings produced by this simple and efficient research strategy can be analysed from two different perspectives. At the "individual level", they represent the individual student's…

Based on theories of emotional intelligence, adult education, psychology of reading, and emotions and literature, this study was designed to develop and validate the Affective Response to Literature Survey (ARLS), a psychological instrument used to measure an emotional response to literature. Initially, 27 items were generated by a review of…

The Idaho Comprehensive Literacy Assessment (ICLA) is a faculty-developed, state-wide, high-stakes assessment of pre-service teachers' knowledge and application of research based literacy practices. The literacy faculty control all aspects of the test, including construction, refinement, administration, scoring and reporting. The test development…

The goal of this project was to produce a set of civic measures with sound psychometric properties appropriate for use with young people ages 12-18. Measures selected tap aspects of adolescent civic behaviors, opinions, knowledge, and dispositions. The measures are easy to administer and can be used by educators, staff of community-based…

Many researchers have investigated the effects of students' prior knowledge upon learning chemistry, for example, the tenacity of alternative conceptions. Knowledge about learning also shapes students' learning of chemistry. This research describes the development of CHEMX, a survey instrument that measures an aspect of knowledge about learning…

The California Chemistry Diagnostic Test (CCDT) was developed by chemistry faculties at the University of California, California State University, and California Community College systems to address dissatisfaction with existing chemistry assessment instruments. The instrument was tested at 25 campuses of the 3 systems, after which Glendale…

The estimation of the internal consistency of a newly constructed instrument using Cronbach's coefficient alpha is demonstrated. This study sought to determine the relationship, if any, between an individual's cognitive style and the preference for certain kinds of information used in making decisions. Cognitive style was determined with the Myers…

This paper deals with the problems that arise in performance assessment from the granularity that results from having a small number of tasks or prompts and raters of responses to these tasks or prompts. Two problems are discussed in detail: (1) achieving a satisfactory degree of reliability; and (2) equating or adjusting for differences of…

The Arabic Picture Vocabulary Test (APVT) was derived from the Peabody Picture Vocabulary Test in order to provide an estimate of a student's acquired verbal ability in Arabic (Modern Standard Arabic) through his or her aural vocabulary. It is an individually administered norm-referenced power test for students aged 5 to 9 plus years. Each item…

A study was conducted to provide information for setting two separate standards, the accuracy score and the documentation score, for the Praxis III: Classroom Performance Assessment (Praxis III). Praxis III is intended for making instructional and licensing decisions about beginning teachers. This standard-setting study was a person-judgment…

A cursory examination of current measurement texts used in teacher education reveals a treatment of such topics as test reliability, item analysis, and test interpretation based largely upon classical test theory. In the meantime, the landscape of the classroom has been significantly impacted by a growing emphasis on more authentic assessment…