Background: Cigarette smoking is a health-risk behavior of global proportions. Self-efficacy plays an important role in both smoking acquisition and smoking resistance. Reliability and validity of an instrument is fundamental to research results, particularly in its simplified form on a different population. The purpose of this study was to…

This experimental project investigated the reliability and validity of rubrics in assessment of students' written responses to a social science "writing prompt". The participants were asked to grade one of the two samples of writing assuming it was written by a graduate student. In fact both samples were prepared by the authors. The…

The purpose of this study was to standardize the Primary Measures of Music Audiation in Greece ( N = 1,188). Split-halves reliability was acceptable across grade levels (K through 3) for the Tonal and Rhythm subtests, but test-retest reliability was generally unacceptable, especially for the Rhythm subtest. Concurrent validity was mixed, with…

The main purpose of the study was to investigate the distinctness and reliability of analytic (or multi-trait) rating dimensions and their relationships to holistic scores and "e-rater"[R] essay feature variables in the context of the TOEFL[R] computer-based test (TOEFL CBT) writing assessment. Data analyzed in the study were holistic…

The purpose of this review was to examine the practice of oral assessment in postgraduate medical education in the context of the core assessment constructs of validity, reliability and fairness. Although oral assessment has a long history in the certification process of medical specialists and is a well-established part of such proceedings for a…

Research has consistently shown that principal leadership matters for successful schools. Evaluating principals on the behaviors shown to improve student learning should be an important leverage point for raising leadership quality. Yet principals are often evaluated with the use of instruments with no theoretical background and little, if any,…

Objectives: The purpose of this article is to create transparency for the psychometric methods employed for the development of the Association of Social Work Boards' (ASWB) exams. Results: The article includes an assessment of the macro (political) and micro (statistical) environments of testing social work competence. The seven-step process used…

We present a novel approach to the automated marking of student programming assignments. Our technique quantifies the structural similarity between unmarked student submissions and marked solutions, and is the basis by which we assign marks. This is accomplished through an efficient novel graph similarity measure ("AssignSim"). Our experiments…

Objective: The present study determined interrater agreement on diagnoses achieved using the parent and child versions of the Anxiety Disorders Interview Schedule for Children for DSM-IV (ADIS-C/P) and examined informant, age, and gender influences on reliability. Method: Diagnoses established for 153 seven- to 16-year-old children during live…

Increasingly, academic institutions are being required to improve the validity of the assessment process; unfortunately, often this is at the expense of reliability. In medical schools (such as Leeds), standardized tests of clinical skills, such as "Objective Structured Clinical Examinations" (OSCEs) are widely used to assess clinical…

The focus of this research is an examination of service quality provided by non-centralized technology personnel, Local Technical Support Providers (LSPs), at a southern research university. The SERVQUAL instrument was selected to measure service quality of LSPs within the Academic Affairs Division. The rationale for selecting and testing SERVQUAL…

In today's world, information is increasingly created, processed, transmitted, and stored digitally. While the digital nature of information has brought enormous benefits, it has also created new vulnerabilities and attacks against data. Unlike physical documents, digitally stored information can be rapidly copied, erased, or modified. The…

The purpose of this study was to explore the relationship between transformational leadership and teacher motivation in Southwestern Arizona high schools. Teachers in a school district in Southwestern Arizona comprised of high schools were surveyed using two instruments, Leithwood and Jantzi's (1998) The Leadership and Management of Schools in…

Reform efforts have emphasized the need to support teachers' learning about reform-oriented practices. Educative curriculum materials are one potential vehicle for promoting teacher learning about these practices. Educative curriculum materials include supports that are intended to promote both student "and" teacher learning. However, little is…

This article reports on the construction and validation of a professional suitability scale, designed for assessing students' suitability for social work practice. Data were collected from 188 field supervisors who provided usable questionnaires, representing a response rate of 74%. Construct validation by exploratory factor analysis identified a…