We developed and provided initial validation for a 15-item scale for use with academics. In Phase 1, we utilized a review of the literature, focus groups, and expert feedback to generate 36 items. In Phase 2, we conducted item and exploratory factor analyses to reduce the number of items and assess the factor structure (N = 212; 51.4% female; mean…

Discrete Choice Experiments (DCEs) are widely used in behavioral sciences to examine how humans value attributes of a technology, how those values drive decisions, and how they make trade-offs. The method has increasingly been used to inform technologies and interventions for addressing critical issues (e.g. disease and hunger). Different formats…

One of the crucial fundamental mathematical skills for students is mathematical communication. This skill pertains to students' ability to convey the ideas and information they have acquired effectively. However, many students still have suboptimal mastery of this skill. Therefore, this study aims to develop worksheets based on realistic…

Research practice partnerships (RPPs) are an increasingly popular approach for bringing together research and practice in ways that can improve and transform education. To date, however, evaluators have lacked measures to evaluate such partnerships. This paper describes a project to develop validity evidence for a survey to evaluate the…

Research funders and policymakers increasingly focus on societal benefits of their investments in research. Research institutions thus face increasing pressure to demonstrate their societal impact to prove their legitimacy and worth. To this end, research institutions need reliable, quantitative methods to measure societal impact. This article…

Alternative high schools serve some of the most vulnerable students and their programs present a significant challenge to evaluate. Determining the impact of an alternative high school that serves mostly at-risk students presented a significant research problem. Few studies exist that dig deeper into the characteristics and strategies of…

Previous systematic reviews indicate a lack of reporting of reliability and validity evidence in subsets of the medical education literature. Psychology and general education reviews of factor analysis also indicate gaps between current and best practices; yet, a comprehensive review of exploratory factor analysis in instrument development across…

Visual attention and visual search are the features of visual perception, essential for attending and scanning one's environment while engaging in daily occupations. This study describes the development of a novel web-based test of visual search. The development information including the format of the test will be described. The test was designed…

This document describes the breadth of the research that the ETS (Educational Testing Service) Research & Development division is conducting in 2010. This portfolio will be updated in early 2011 to reflect changes to existing projects and new projects that were added after this document was completed. The research described in this portfolio falls…

This document describes the breadth of the research being conducted in 2008 by the Research and Development Division at Educational Testing Service (ETS). The research described falls into three large categories: (1) Research supported by the ETS research allocation; (2) Research funded by testing programs at ETS; and (3) Research funded by…