This article describes and field-tests the improved rate difference (IRD), a new effect size for summarizing single-case research data. Termed "risk difference" in medical research, IRD expresses the difference in successful performance between baseline and intervention phases. IRD can be calculated from visual analysis of nonoverlapping data, and…

Attali (2005) recently demonstrated that Cronbach's coefficient [alpha] estimate of reliability for number-right multiple-choice tests will tend to be deflated by speededness, rather than inflated as is commonly believed and taught. Although the methods, findings, and conclusions of Attali (2005) are correct, his article may inadvertently invite a…

This article presents a study conducted by Cornelia Yarbrough and Jennifer Whitaker titled "Analysis of Reviewer Comments About Quantitative Manuscripts Accepted by the "Journal of Research in Music Education"." The study aims to analyze reviewers' comments for quantitative manuscripts with regard to the following categories: section discussed…

This article presents the author's critique of R. Stephen RiCharde's argument in his essay on the humanities and interrater reliability in the July-August 2008 issue of "Assessment Update." RiCharde suggests that the humanities' historical commitment to a dialectical pedagogy, a "nonlinear" process that values disagreement and debate, is at odds…

If a person were to ask an educator to identify the two most important attributes of an education test, the response most certainly would be "validity and reliability." These two tightly wedded concepts have become icons in the field of education assessment. As far as validity is concerned, the term doesn't refer to the accuracy of a test. Rather,…

Standard setting methods such as the Angoff method rely on judgments of item characteristics; item response theory empirically estimates item characteristics and displays them in item characteristic curves (ICCs). This study evaluated several indexes of rater fit to ICCs as a method for judging rater accuracy in their estimates of expected item…

We examined the internal consistency, test-retest reliability, and the responsiveness of the Bruininks-Oseretsky Test of Motor Proficiency-Second Edition (BOT-2) for children with intellectual disabilities (ID). One hundred children with ID aged 4-12 years tested on 3 separate occasions: two baseline measurements with a 2-week interval before the…

The pressing need for English oral communication skills in multifarious contexts today is compelling impetus behind the large number of studies done on oral proficiency interviewing. Moreover, given the recently articulated concerns with the fairness and social dimension of such interviews, parallel concerns have been raised as to how most fairly…

Response to Intervention (RTI) is an educational approach that integrates ongoing assessment of individual student progress with targeted instruction. Administrators and teachers in P-12 schools expressed a need for colleagues in higher education to provide training to general education pre-service and in-service teachers in selecting appropriate…

Each classroom has its own assessment environment perceived by the students and springs from the teacher's assessment practices. Although students' perceptions of the assessment environment may influence their achievement-related outcomes, little attention has been given to the measurement of perceived classroom assessment environment. This study…

In 2009, a PK-12 public school district board of education approved a teacher evaluation tool developed by a volunteer team of teachers and administrators. The Learning Based Teacher Evaluation (LBTE) was constructed with six broad standards and fifteen specific criteria. The standards and criteria were assumed important to professional practice,…

Quality measurement serves as a foundation for child care Quality Rating and Improvement Systems (QRIS). Understanding the variation that exists in quality measurement, the different contexts in which states make decisions, and the factors that play into their decisions can help administrators identify where their state may fall along the spectrum…

Academic dishonesty has recently been described as an epidemic illness and a phenomenon to be definitely prevented. Accordingly, prospective teachers are expected to have high ethical judgement levels. The section who suffers most from academic dishonesty is also teachers who serve in various ranks. Individuals with high ethical judgement levels…

Although researchers have succeeded in identifying knowledge and skills and personal traits and characteristics of effective leaders, they have not been nearly as successful in identifying or defining those elusive leadership qualities that fall into the affective domain--what the National Council for the Accreditation of Teacher Education (NCATE)…

This article describes the development of a ten-item scale to assess biology majors' self-efficacy towards the critical thinking and data analysis skills taught in an upper-division cell biology course. The original seven-item scale was expanded to include three additional items based on the results of item analysis. Evidence of reliability and…