The purpose of this synthesis study was to assess the reliability and validity of the Draw-A-Scientist Test (DAST) and its variations across multiple studies, aiming to understand limitations and propose modifications for future application within and beyond the science domain. Given the existence of multiple DAST versions, this study quantified…

Standards for accreditation by the Association to Advance Collegiate Schools of Business emphasize the assessment of student learning as an avenue to continuously improve business school curricula. The study reported here, which took place in an Association to Advance Collegiate Schools of Business-accredited business school in a mid-sized…

Considerable past classroom learning environment research has focused on the primary and secondary levels of education and the subject areas of science and mathematics. The current study is distinctive in its focus on university business statistics learning environments. For the first time, we validated and applied the widely-used What Is…

English language programmes provide established pathways for international students seeking university admission in countries such as Australia and the United Kingdom. In order to refer international applicants to appropriate levels and durations of English language support prior to matriculation into their main course of study, pathway providers…

This article describes the development and validation of a survey instrument, the "Writing Strategies for Motivational Regulation Questionnaire" ("WSMRQ"), designed to measure Chinese university students' reported use of motivational regulation strategies in writing in English as a second/foreign language (L2). Conceptualized…

Curricular changes that promote undergraduate persistence in science, technology, engineering, and mathematics (STEM) disciplines are likely associated with particular student psychological outcomes, and tools are needed that effectively assess these developments. Here, we describe the theoretical basis, psychometric properties, and predictive…

Objective: This study seeks to evaluate the psychometric properties of the Ottawa Self-Injury Inventory-Functions (OSI-F) for assessing nonsuicidal self-injury (NSSI), a condition for further study in the DSM-5. Participants: Participants included 345 students who indicated a history of self-injury in a university counseling center over six…

The project examined the predictive validity of the "TOEFL iBT"® test with a focus on the relationship between TOEFL iBT scores and students' subsequent academic success in postgraduate studies in one leading university in the United Kingdom, paying specific attention to the role of linguistic preparedness as perceived by students and…

Accountability mandates often prompt assessment of student learning gains (e.g., value-added estimates) via achievement tests. The validity of these estimates have been questioned when performance on tests is low stakes for students. To assess the effects of motivation on value-added estimates, we assigned students to one of three test consequence…

This study investigated the reliability and validity of the Behavior Rating Inventory of Executive Functions-Adult Form (BRIEF-A) when used with deaf college students. The BRIEF-A was administered to 176 deaf and 184 hearing students of whom 25 deaf students and 56 hearing students self-identified as having an Attention Deficit Hyperactivity…

Relational reasoning is the foundational cognitive ability to discern meaningful patterns within an informational stream, but its reliable and valid measurement remains problematic. In this investigation, the measurement of relational reasoning unfolded in three stages. Stage 1 entailed the establishment of a research-based conceptualization of…

Remediation is one of the largest single interventions intended to improve outcomes for underprepared college students, yet little is known about the remedial screening process. Using administrative data and a rich predictive model, we find that severe mis-assignments are common using current test-score-cutoff-based policies, with…

Students tend to believe that RateMyProfessors.com (RMP) is an unfailingly valid measure of teaching effectiveness, and in fact viewing that site prior to taking a course can have a direct influence on their future evaluations of faculty. The authors describe an activity whose objective is to have students analyze different types of validity using…

The authors articulate objections to the organization of the recent special issue on student engagement and respond in detail to three criticisms leveled in that issue. Situating their response relative to longstanding calls to make research more relevant to practice, they argue that the validity critique inappropriately focuses on criterion…

At an annual cost of roughly $7 billion nationally, remedial coursework is one of the single largest interventions intended to improve outcomes for underprepared college students. But like a costly medical treatment with non-trivial side effects, the value of remediation overall depends upon whether those most likely to benefit can be identified…