e-Learning acceptance has received considerable attention in the educational technology literature. In recent years, many frameworks have been proposed, modified, and applied to better understand the factors underlying students' acceptance of e-learning. Despite the important progress made with the acceptance literature, extant empirical…

The purpose and outcome of this study was to provide insight into clearly articulated parameters that might serve as a basis for the development of a generalizable outcomes-based funding model that any higher education system could use. Funding models were analyzed and telephone interviews were conducted from the ten states that were identified by…

The extant literature has largely ignored a potentially significant source of variance in multiple mini-interview (MMI) scores by "hiding" the variance attributable to the sample of attributes used on an evaluation form. This potential source of hidden variance can be defined as rating items, which typically comprise an MMI evaluation…

This resource has been written specifically for higher education practitioners who are interested in improving students' learning experiences through the process of researching their own practice. We use the term 'higher education practitioners' to describe all who work in universities and who have a stake in students' learning experiences.…

The big data imposes the key problem of generalizability of the results. In the present contribution, we discuss statistical tools which can help to select variables adequate for target level of abstraction. We show that a model considered as over-fitted in one context can be accurate in another. We illustrate this notion with an example analysis…

The multiple mini-interview (MMI) has become an increasingly popular admissions method for selecting prospective students into professional programs (e.g., medical school). The MMI uses a series of short, labour intensive simulation stations and scenario interviews to more effectively assess applicants' non-cognitive qualities such as…

Intraclass correlation coefficients (ICCs) are commonly used in behavioral measurement and psychometrics when a researcher is interested in the relationship among variables of a common class. The formulas for deriving ICCs, or generalizability coefficients, vary depending on which models are specified. This article gives the equations for…

Prior research indicates that the overall reliability of performance ratings can be improved by using ordinary least squares (OLS) regression to adjust for rater effects. The present investigation extends previous work by evaluating the impact of OLS adjustment on standard errors of measurement ("SEM") at specific score levels. In…

Higher Education Support Personnel support the faculty in fulfilling the mission of America's colleges and universities. Rarely studied, these personnel include position classifications such as support/service professionals, technical/paraprofessionals, clerical and secretarial, service/maintenance, and skilled crafts. The support/service…

Peer and self-ratings have been strongly recommended as the means to adjust individual contributions to group work. To evaluate the quality of student ratings, previous research has primarily explored the validity of these ratings, as indicated by the degree of agreement between student and teacher ratings. This research describes a…

Peer review is valued in higher education, but also widely criticized in terms of potential biases, particularly gender. We evaluate gender differences in peer reviews of grant applications, extending Bornmann, Mutz, and Daniel's meta-analyses that reported small gender differences in favor of men (d = 0.04), but a substantial heterogeneity in…

The authors center their presentation of material around a conceptual understanding of psychometric issues, such as validity and reliability, and on purpose rather than procedure, the "why" rather than the "how to." Their goal is to introduce psychometric principles at a level that is deeper and more focused than found in introductory…

Increased demands for colleges and universities to engage in outcomes assessment for accountability purposes have accelerated the need to bridge the gap between higher education practice and the fields of measurement, assessment, and evaluation. The "Handbook on Measurement, Assessment, and Evaluation in Higher Education" provides higher…