As a result of the increase in online course offerings at colleges and universities, the prevalence of online and computerized examinations has increased over the last two decades. Beyond academia, online examinations have been used to assess competence for certifications by both governments and private firms. Despite this importance, a randomized…

Category learning is fundamental to cognition, but little is known about how it proceeds in real-world environments when learners do not have instructions to search for category-relevant information, do not make overt category decisions, and do not experience direct feedback. Prior research demonstrates that listeners can acquire task-irrelevant…

Open-ended tasks are common in Science, Technology, Engineering and Mathematics (STEM) education. However, as far as we know, no tools have been developed to assist in the assessment of the solution process of open-ended questions. In this paper, we propose the use of analysis of traces as a tool to address this need. To illustrate this approach,…

In this paper, I describe the design and evaluation of automated essay scoring (AES) models for an institution's writing placement program. Information was gathered on admitted student writing performance at a science and technology research university in the northeastern United States. Under timed conditions, first-year students (N = 879) were…

The present research examined the extent to which pre-college characteristics, high school experiences, college expectations, and initial enrollment characteristics were related to graduation from college. Data from admission applications, the "ACT Compass" survey, and initial enrollment measures for Fall 2004 and Fall 2005 first-time…

This study investigated the use of automated essay scoring (AES) to identify at-risk students enrolled in a first-year university writing course. An application of AES, the "Criterion"[R] Online Writing Evaluation Service was evaluated through a methodology focusing on construct modelling, response processes, disaggregation, extrapolation,…

Utilizing empirical data from an online satisfaction survey of over ten thousand full-time, pre-tenure (tenure -track) faculty members at 120 institutions, as well as qualitative data from interviews with seventy-three faculty and administrators at six research universities, this paper highlights the most important factors in the success and…