This article reports and demonstrates two SPSS macros for calculating Krippendorff's alpha and intraclass reliability coefficients in repetitive situations where numerous coefficients are needed. Specifically, the reported SPSS macros were used to evaluate the interrater agreement and reliability of student evaluations of teaching in thousands of…

In this article, the author talks about the auto correction mode of word processors that leads to a number of problems and describes an example in biochemistry exams that shows how word processors can lead to mistakes in databases and in papers. The author contends that, where this system is applied, spell checking should not be left to a word…

Systematic quantitative research on measuring distributed leadership is scarce. In this study, the Distributed Leadership Inventory (DLI) was developed and evaluated to investigate leadership team characteristics and distribution of leadership functions between formally designed leadership positions in large secondary schools. The DLI was…

The aim of the current study is twofold: (a) to investigate the rates at which researchers assess and report on the psychometric properties of the measures they use in their research and (b) to examine whether or not researchers appear to be generally employing sound/unsound rationales when it comes to how they conduct test evaluations. Based on a…

In this study, the authors report on the validity and reliability of a paper-and-pencil instrument called SET37 used for Student Evaluation of Teaching (SET) in higher education. Using confirmatory factor analysis on 2525 questionnaires, a revalidation of the SET37 shows construct and discriminant validity of the 12 dimensions included in the…

Despite revolutionary changes in technology, the challenges facing institutional research professionals remain remarkably the same as they were a decade ago. They are still meeting disparate stakeholder demands, developing new skills, adopting new roles, and finding ways to communicate complex information through clear presentation of data. Then…

Purpose: The purpose of this paper is to show how to construct a strategy canvas for a business school based on students' perceptions of the importance of critical value dimensions of its undergraduate offering(s) and its comparable performance on each. This can be used in evaluating the school's extant strategy and in developing a new innovative…

This article argues that editing in the era of digital literacies is a complex, collaborative endeavor that requires a sophisticated awareness of audience and purpose and a knowledge of multiple conventions for conveying meaning and ensuring accuracy. It compares group editing of an article about the New York Yankees baseball team on Wikipedia,…

The most commonly used measure of anxiety sensitivity is the 36-item Anxiety Sensitivity Index--Revised (ASI-R). Exploratory factor analyses have produced several different factors structures for the ASI-R, but an acceptable fit using confirmatory factor analytic approaches has only been found for a 21-item version of the instrument. We evaluated…

The author previously published a paper discussing how to conduct an analysis based on a cluster sample. In that paper, the author outlined several widely adopted alternative approaches, and pointed out that such approaches are anyway not needed for population figures, and not possible for non-probability samples. Thus, the author queried the…

The lack of empirical research relating temperament models and personality hinders conceptual integration and holds back research linking childhood traits to problem behavior or maladjustment. This study evaluates, within a sample of 443 preschoolers, the relationships between children's maladaptation and traits measured by three temperament…

This study examined whether teacher portfolios can be validly and reliably assessed by investigating the effect of an instructional tool on increasing the level of reflective thinking in elementary preservice teachers' portfolios. It also examined whether reflective thinking in preservice teachers' electronic portfolios represented sufficient…

The current article presents the findings on the development of a student evaluation instrument in which course evaluation is directly tied to student learning outcomes. With a committee consisting of instructors from six distinct disciplines brought together as part of a working group for this purpose, the instrument was developed utilizing…

Previous systematic reviews indicate a lack of reporting of reliability and validity evidence in subsets of the medical education literature. Psychology and general education reviews of factor analysis also indicate gaps between current and best practices; yet, a comprehensive review of exploratory factor analysis in instrument development across…

An instrument comprising sixteen original vignettes was field tested to gather evidence of their validity and reliability in measuring heterosexist attitudes among educators. Two-hundred seventy pre-service and in-service teachers and counselors completed the instrument. The items were analyzed using statistical methods informed from Classical…