Research funders and policymakers increasingly focus on societal benefits of their investments in research. Research institutions thus face increasing pressure to demonstrate their societal impact to prove their legitimacy and worth. To this end, research institutions need reliable, quantitative methods to measure societal impact. This article…

The conventional focus of validity in educational measurement has been on intended interpretations and uses of test scores. Empirical studies of test use by teachers, administrators and policy-makers show that actual interpretations and uses of test scores in context are invariably shaped by local users' questions, which frequently require…

A growing body of research documents the positive outcomes of research experiences for undergraduates, including increased persistence in science. Study of undergraduate lab learning experiences has demonstrated that the design of the experience influences the extent to which students report ownership of the project and that project ownership is…

The ability to reason scientifically and communicate research appropriately is central to psychological literacy. Scientific research has little value unless scientists are able to convey results and their consequences clearly to others. In this study, we outline a method of assessing the development of psychological literacy in undergraduate…

Laboratory courses serve as important gateways to science, technology, engineering, and mathematics education. One of the challenges in assessing laboratory learning is to conduct meaningful and standardized practical exams, especially for large multisection laboratory courses. Laboratory practical exams in life sciences courses are frequently…

The hypothesis was tested that subjects fake personality tests by enacting a specific social role, rather than by responding in terms of personality constructs, and that such role faking cannot be detected by validity scales. Results support the hypothesis. (Author)

Predictive validity of the Differential Aptitude Test (DAT) was investigated by comparing the DAT scores obtained by students in Grade 9 against their achievement in Grade 12 departmental examinations. Results indicated that the DAT has good predictive power and can be used effectively on a selective basis for counseling and predictive purposes in…

This article compared the concurrent predictive accuracy of the (SVIB) for the same subjects on three sets of scales, the SVIB-Holland scales, the Basic Interest scales, and the Occupational scales. (Author)

A sample of male Investigative subjects (N=171) who completed the SDS as freshmen in 1970 was sent a questionnaire four years later. Results indicated that, for Investigative-type freshman males, the SDS has moderately high efficiency in predicting, four years later, their ultimate major and their immediate and future vocational plans. (Author)

Two Minnesota Importance Questionnaire (MIQ) scales, Creativity and Independence were validated by experiment. Subjects (N=68) were exposed to four task conditions representing joint combinations of high or low levels of Creativity and Independence. The behavioral results were consistent with the subjects' MIQ score levels on the two scales,…

A scoreable biographical data key was developed for a group of women lower level managers, and applied to male and female managers. Showed statistical validity for both the cross-validation sample and for the samples of female and male managers. (Author)

Title I elementary school children (N=37) were administered the Arithmetic subtest of the Wide Range Achievement Test and the Key Math Diagnostic Arithmetic Test. One year later, the Metropolitan Achievement Test was administered. Correlations between the three measures are presented and discussed. (Author)

This document describes the breadth of the research that the ETS (Educational Testing Service) Research & Development division is conducting in 2010. This portfolio will be updated in early 2011 to reflect changes to existing projects and new projects that were added after this document was completed. The research described in this portfolio falls…

Predictive validity of a school readiness test (Preschool Screening System (PSS)) was investigated through a teacher rating scale (Rhode Island Pupil Identification Scale) to six groups of kindergarten children of both sexes (N=245). The most powerful predictor in every group was the "Information Processing" score of the PSS. (Author)

A novel statistical technique was used to look at the interactions of the reliabilities of personality measures with each other and with the personality scores themselves. (Author)