Altmetrics are tools for measuring the impact of research beyond scientific communities. In general, they measure online mentions of scholarly outputs, such as on online social networks, blogs, and news sites. Some stakeholders in higher education have championed altmetrics as a new way to understand research impact and as an alternative or…

The case study addressed in this article illustrates the value of continuous response measurement (CRM) for testing and refining messages produced for distribution to Extension audiences. We used CRM to evaluate the responses of Extension educators and Natural Resources Conservation Service technical service providers to a video describing…

This report describes an initiative undertaken from 2016-2017 by the Center for Universal Education (CUE) at the Brookings Institution and Education International (EI) to develop tools to measure the breadth of learning opportunities to which children and youth are exposed in an education system. The Breadth of Learning Opportunities (BOLO)…

The absence of universally accepted definitions for direct and indirect assessment motivates the purpose of this article: to offer definitions that are literature-based and theoretically driven, meeting K. Lewin's (1945) dictum that, "There is nothing so practical as a good theory" (p. 129). The authors synthesize the literature to…

The author reports on the debate about "value added" measures of teaching which may be the most divisive topic in teacher-quality policy today. It has generated sharp-tongued exchanges in public forums, in news stories, and on editorial pages. And it has produced enough policy briefs to fell whole forests. But for most of the nation's teachers,…

The primary purpose of this paper is to call leadership educators to intentionally engage in a conversation regarding how we ensure participants of our programs are learning what we hope they learn. To achieve this principal aim, this paper will (1) briefly examine pressures compelling our discipline to engage in intentional conversations…

Evaluative statements from alumni have legitimacy with both internal and external stakeholders. Thus, alumni studies can provide valuable evidence of institutional effectiveness and lend themselves to both locally designed and commercial survey instruments for data collection. Under ideal conditions, the results of alumni studies equip faculty and…

Reports preliminary results of a study to develop and automate new metrics for assessment of information quality in text documents, particularly in news. Through focus group studies, quality judgment experiments, and textual feature extraction and analysis, nine quality aspects were generated and applied in human assessments. Experiments were…

Introduces the Monte Carlo method which is shown to represent an attractive alternative to the hypergeometric model for identifying the levels at which random retrieval performance is exceeded in retrieval test collections and for overcoming some of the limitations of the hypergeometric model. Practical matters to consider when employing the Monte…

This booklet provides suggestions for possible sources of information for each of the student performance indicators listed in the National Center on Educational Outcomes' conceptual model for students in fourth grade, including students with disabilities. The model has eight outcome domains, each with several outcomes and indicators of outcomes.…

Techniques used at Tufts University to evaluate its achievement and goals for institutional development efforts before beginning a new program are outlined, including identifying and assessing competition, finding measures of support volume and importance to the institution, and comparing one's own institution with others in actual and potential…

Presents preliminary findings of a project intended to develop a user-validated measurement instrument based on users' relevance criteria. Two validation tests revealed conceptual and methodological challenges involving the semantic ambiguity of terms and verified the importance of situational context to scale development and use. (Author/AEF)

To manage Web-based resources effectively, librarians must evaluate vendor-supplied data about their use. Identifies aspects of data collection librarians need to pay special attention to, recommends that vendors report the maximum number of simultaneous users per day and data gaps in addition to International Coalition of Library Consortia…

This booklet provides suggestions for possible sources of information for each of the student performance indicators listed in the National Center on Educational Outcomes' conceptual model for eighth-grade students, including students with disabilities. The model has eight outcome domains, each with several outcomes and indicators of outcomes. For…

This monograph provides a directory of publications and information systems that may be useful in the search for test-related information. Some strategies for conducting an information search are also included. There are three main sections in this monograph: Print Publications, which includes books and journal articles; Test Information Systems,…