The views of prominant qualitative methodologists on the appropriateness of validity and reliability estimation for the measurement strategies employed in qualitative evaluations are summarized. A case is made for the relevance of validity and reliability estimation. Definitions of validity and reliability for qualitative measurement are presented…

Argues that interrater reliability, traditionally used in phenomenographic research, is unreliable for establishing the reliability of research results; it does not take into account the researcher's procedures for achieving fidelity to the individuals' conceptions investigated, and use of interrater reliability based on objectivist epistemology…

Although summative assessment is indispensable for determining whether or not students meet the content standards, it alone is insufficient for providing teachers and administrators with the information necessary to make ongoing decisions about instruction. This article looks at the motivational impact of the assessment on students' achievement…

This research evaluated the inter-rater reliability of the Performance Assessment for California Teachers (PACT). Multiple methods for estimating overall rater consistency include percent agreement and Cohen's Kappa (1960), which yielded discrepancies between rater agreement in terms of whether candidates passed or failed particular PACT rubrics.…

This study examined the effect of linguistic modification on middle school students' ability to show what they know and can do on math assessments. REL West's study on middle school math assessment accommodations found that simplifying the language--or linguistic modification--on standardized math test items made it easier for English Language…

The research presented in this manuscript was focused on the development of assessments for engineering design outcomes. The primary goal was to support efforts by the Transferrable Integrated Design Engineering Education (TIDEE) consortium in developing assessment instruments for multidisciplinary engineering capstone courses. Research conducted…

The Texas Assessment of Academic Skills (TAAS) test was the major source of data for the Texas educational accountability system from 1994 through 2002. Contrary to critics who claim that TAAS data are invalid and unreliable measures of student performance, structural equation analyses of TAAS reading data based on the 1994 Texas third grade…

The authors reviewed the acculturation literature with the goal of identifying measures used to assess acculturation in Hispanic populations in the context of studies of health knowledge, attitudes, and behavior change. Twenty-six acculturation measures were identified and summarized. As the Hispanic population continues to grow in the United…

The National Student Survey (NSS) of course experience satisfaction is sent to final year students of all higher education institutions in England, Northern Ireland, Scotland and Wales (N = 171,290 and 157,342 students in 2005 and 2006) and results are made publicly available. The present investigation assesses the reliability and appropriate use…

The primary goals of this project were to develop a reliable instrument to measure the chemistry course perceptions (CCP) of undergraduate chemistry students and to determine the predictors of CCP of undergraduate students as they enter their first college chemistry class. In a pilot study, 250 undergraduate students were solicited with 57…

This paper proposes a self-regulated learning (SRL) system with scaffolding support in order to develop independent learning skills among students. The SRL system uses self-regulated learning and scaffolding theories to appeal to both instructors and learners. On the part of the instructors, a Content Accessibility Subsystem is provided to easily…

Sense of Community (SoC) is a key theoretical construct in community psychology. This study validated a SoC scale for adolescents (SoC-A) in Italy. The scale comprises 20 items and five components: satisfaction of needs and opportunities for involvement; support and emotional connection with peers; support and emotional connection in the…

The intent of this study was to develop an instrument to measure the current level of attitude that students' exhibit toward STEM education. "The Concerns-Based Adoption Model, Taxonomy of Education Objectives-Handbook II," and other pertinent instruments were utilized as sources of inspiration for the instrument. The selected items were submitted…

This study used an online peer assessment activity to help 47 college students to learn biology through writing. Each student submitted a biology writing report to an online system and then experienced three rounds of peer assessment. During the online peer assessment process, self, peer and expert evaluation scores for the writing were gathered…

We examined internal consistency and test-retest reliability of a measure of dispositional optimism, the Life Orientation Test-Revised, in 121 opiate-dependent patients seeking methadone treatment. Internal consistency was adequate at baseline (alpha = 0.69) and follow-up (alpha = 0.72). Low socioeconomic status and being on disability were…