This article outlines an active learning project that gives students hands-on experience in developing an undergraduate situational judgment test. The five-part activity models the process for constructing a situational judgment test--a tool commonly used for employee selection in organizations. The project is designed to help students assimilate…

Lagged dependent variables (LDVs) are often used as predictors in ordinary least squares (OLS) models in the social sciences. Although several estimators are commonly employed, little is known about their relative merits in the presence of classical measurement error and different longitudinal processes. We assess the performance of four commonly…

By design, randomized experiments (XPs) rule out bias from confounded selection of participants into conditions. Quasi-experiments (QEs) are often considered second-best because they do not share this benefit. However, when results from XPs are used to generalize causal impacts, the benefit from unconfounded selection into conditions may be offset…

Scoring high-dimensional assessments (e.g., > 15 traits) can be a challenging task. This paper introduces the multilabel neural network (MNN) as a scoring method for high-dimensional assessments. Additionally, it demonstrates how MNN can score the same test responses to maximize different performance metrics, such as accuracy, recall, or…

The goal in personalized assessment is to best fit the needs of each individual test taker, given the assessment purposes. Design-In-Real-Time (DIRTy) assessment reflects the progressive evolution in testing from a single test, to an adaptive test, to an adaptive assessment "system." In this paper, we lay the foundation for DIRTy…

The goal in personalized assessment is to best fit the needs of each individual test taker, given the assessment purposes. Design-in-Real-Time (DIRTy) assessment reflects the progressive evolution in testing from a single test, to an adaptive test, to an adaptive assessment "system." In this article, we lay the foundation for DIRTy…

More than three decades after their introduction, diagnostic classification models (DCM) do not seem to have been implemented in educational systems for the purposes they were devised. Most DCM research is either methodological for model development and refinement or retrofitting to existing nondiagnostic tests and, in the latter case, basically…

Packed with new topics that reflect today's challenges, the Sixth Edition of the bestselling "How to Conduct Surveys" guides readers through the process of developing their own rigorous surveys and evaluating the credibility and transparency of surveys created by others. Offering practical, step-by-step advice and written in the same…

Educators and researchers highlight the important role that math plays as a consequential gateway to upward mobility in the United States (and globally). The purpose of this study was to develop a survey for teens in middle school and high school, to capture information about their math mindsets, identities, experiences studying math, and…

We describe here the development and validation of the Academic Career Readiness Assessment (ACRA) rubric, an instrument that was designed to provide more equity in mentoring, transparency in hiring, and accountability in training of aspiring faculty in the biomedical life sciences. We report here the results of interviews with faculty at 20 U.S.…

The social validity of intervention research has been emphasized in special education and related fields for decades. There is relatively little focus on social validity that considers culturally and linguistically diverse populations. Eleven articles met the inclusionary criteria for this systematic review and were evaluated to describe social…

To date, a comprehensive review of supervisory relationship measures has yet to be published. In this article, the authors explore conceptualizations of the supervisory relationship, describe and critique 11 measures, provide recommendations for researchers and practitioners when selecting measures, and offer suggestions regarding future measure…

College instructors in the United States usually make their own decisions about how to design course exams. Even though summative course exams are well known to be important to student success, we know little about the decision making of instructors when designing course exams. To probe how instructors design exams for introductory biology, we…

The training of teachers is one of the most critical factors in improving the quality of teaching and assessment in the classroom. EFL teachers need to be literate in language assessment; this can be achieved through training. A total of 147 Junior High School EFL teachers was surveyed to identify their training needs in assessmen. Semi-structured…

Coursebook evaluation helps practitioners decide on the most appropriate coursebook to be exploited. Moreover, evaluation process enables to predict the potential strengths and weaknesses of a given coursebook. Checklist method is probably the most widely adopted way of judging coursebooks and there are plenty of ELT coursebook evaluation…