When examinees perceive a test as low stakes, it is logical to assume that some of them will not put out their maximum effort. This condition makes the validity of the test results more complicated. Although many studies have investigated motivational fluctuation across tests during a testing session, only a small number of studies have…

This study presents an extension of the validity argument for the PCK-Fractions measure. PCK-Fractions is designed to assess the effectiveness of professional experiences in facilitating teachers' pedagogical content knowledge (PCK) for children's fraction reasoning in grades 3-5. We examined data across 101 participants from two Midwest…

Dynamic Measurement Modeling (DMM) is a psychometric paradigm that uses longitudinal data to estimate students' capacity to learn over the course of an educational program (i.e., growth scores). Here, we provide justification for this approach in health professions education and demonstrate its proof of concept with three time-points of USMLE Step…

With rising importance of collaborative problem-solving skills (CLPS) for the new information age, the PISA 2015 assessed students' CLPS skills on a large scale. This new attempt to measure CLPS raises an issue of validity. The purpose of this research is to examine evidence for convergent validity of CLPS through investigating the relationships…

The main purpose of the study is to evaluate the qualities of human essay ratings for a large-scale assessment using Rasch measurement theory. Specifically, Many-Facet Rasch Measurement (MFRM) was utilized to examine the rating scale category structure and provide important information about interpretations of ratings in the large-scale…

This paper demonstrates how to apply Machine Learning (ML) techniques to analyze student interaction data collected in an online mathematics game. We examined: (1) how different ML algorithms influenced the precision of middle-school students' (N = 359) performance prediction; and (2) what types of in-game features were associated with student…

High school graduation is "not yet a reliable indicator of college readiness", (Gaertner & McClarty, 2015, p2). As such, researchers are investigating the use of non-cognitive factors as predictors of college and career readiness (CCR). The College and Career Readiness English Language Arts (ELA) Scale was designed to measure…

Deep Reinforcement Learning (DRL) has been shown to be a very powerful technique in recent years on a wide range of applications. Much of the prior DRL work took the "online" learning approach. However, given the challenges of building accurate simulations for modeling student learning, we investigated applying DRL to induce a…

Objective: To describe the quantitative validation of a unique questionnaire to measure moral distress among social workers in long-term care facilities in Israel. Method: Overall, 216 long-term care facilities' social workers took part in the pilot study that included psychometric evaluation and construct validation. Moral distress was examined…

We explore generalizability and fairness across sociodemographic groups for predicting on-time college graduation using a national dataset of 41,359 college applications. Our features include sociodemographics, institutional graduation rates, academic achievement, standardized test scores, engagement in extracurricular activities, and work…

The core area is made up of muscles, which surrounds the human body like a corset and acts in the stabilization of the body. Core stabilization training can strengthen muscles in this area and provide better stabilization. The purpose of this study is; investigate of the effect of 8-weeks core stabilization training on the FMS (Functional Movement…

Associations between scale scores obtained from a teacher observation-based authentic assessment measure, the "Teaching Strategies GOLD®", and (a) teacher ratings of children's social functioning and learning behaviors, and (b) child performance on external, individually administered direct assessments of academic skills are presented.…

In this study, it is aimed to adapt the Scientific Reasoning Scale (SRS) into Turkish. The translated form has been provided to the students enrolled at different levels together with a form in which they were requested to present what they have understood and the reason of their responses. It was seen that the explanations of students to one item…

The reliability of an assessment is defined as the extent to which candidates' results would remain stable if the entire assessment exercise was repeated. Whilst numerous studies have evaluated the reliability of written examinations, relatively little has been done to quantify the reliability of internal teacher assessment within schools. This is…

Validity evidence to support the use of exam scores for admission to postsecondary institutions is generally provided in the form of correlation coefficients. The measures used to establish the correlations are scores on a particular entrance exam and most typically a student's first-year college grade point average (FYGPA). Correlations…