A grand challenge is a problem that requires broad cooperation for successful resolution from a community of scholars. Several national and international organizations have generated lists of grand challenges to unify the efforts of scholars and practitioners in a field. However, the field of assessment has yet to identify its own set of grand…

The role and impact of diversity in higher education has permeated conversations about student access and achievement for many years. Language articulated by various courts suggests that higher education policies should reflect a broad conceptualisation of diversity beyond that of the magnitude and proportion of race and ethnicity, yet…

The aim of this article is three-fold: (a) to present an example of best practices in formative assessment in university instruction, offering three different methods of learning and assessment to pass a subject; (b) to analyze differences in academic performance depending on method of learning and assessment chosen; (c) to consider professors'…

These proceedings contain the papers of the 16th International Conference on Cognition and Exploratory Learning in the Digital Age (CELDA 2019), held during November 7-9, 2019, which has been organized by the International Association for Development of the Information Society (IADIS) and co-organised by University Degli Studi di Cagliari, Italy.…

This document describes the breadth of the research that the ETS (Educational Testing Service) Research & Development division is conducting in 2010. This portfolio will be updated in early 2011 to reflect changes to existing projects and new projects that were added after this document was completed. The research described in this portfolio falls…

These proceedings contain the papers of the 14th International Conference on Cognition and Exploratory Learning in the Digital Age (CELDA 2017), 18-20 October 2017, which has been organized by the International Association for Development of the Information Society (IADIS) and endorsed by the Japanese Society for Information and Systems in…

Describes a paper-and-pencil method for producing reaction-time data suitable for group situations. The technique was constructed to contrast the two traditional theoretical approaches to semantic memory but can be applied to other questions of cognitive psychology. (Author/CK)

The construction of attitude measures frequently requires the identification of relevant areas to be measured. Latent partition analysis can be used to develop conceptually independent sub-scales by pooling the expertise of several persons. An example and suggestions of its applicability in other areas are provided. (Author/JKS)

Compared four standard-setting procedures for an objective structure clinical examination (OSCE) in medical education. Applied Angoff, borderline, relative, and holistic procedures to the data used to establish a cutoff score for a pass/fail decision. The Angoff and borderline procedures gave similar results; however, the relative and holistic…

The Figure Location Test (FLT) developed by Donlon, Reilly and McKee to provide a machine-scorable test of the cognitive style called field dependence-field independence, was administered as the experimental section of the October 1976, Graduate Record Examination (GRE) Aptitude Test at about one third of the centers in the United States. Initial…

Analyses of questionnaire data from a program evaluation indicate that the two dichotomous items "Would you recommend this to a friend?" and "Would you choose to do this again?" are not as interchangeable as might be expected from the survey literature. As part of the evaluation of a university program, a survey of graduates…

Examined a process for unifying two teacher self-efficacy scales, providing a common metric for communicating and comparing results. Data from 118 education students indicated that items from the two scales defined a unidimensional construct. Correlations between person measures from the two scales demonstrated their strengths for measuring…

This paper provides an overview of the entire process necessary to developing a university-wide web survey, from the community-building process for creating support for the survey and determining the questions, to the specific tasks necessary for designing and administering an efficient web product. (Contains 17 tables.)

The external audit is a way of assessing the trustworthiness of a study, attesting to its dependability from a methodological standpoint and to its confirmability by reviewing the data, analysis, and interpretations and assessing whether the findings represent the data accurately. This paper discusses issues in the audit process, drawing on data…

The Department of Measurement, Statistics, and Evaluation (EDMS) at the University of Maryland is working to develop Master's degree programs that are oriented around developing assessment professionals for work in applied settings. Two fundamentally different sets of experiences are being developed: (1) assessment development, administration, and…