The purpose of this study is to demonstrate clustering methods within a functional data analysis (FDA) framework for identifying subgroups of individuals that may be exhibiting categories of misfit. Person response functions (PRFs) estimated within a FDA framework (FDA-PRFs) provide graphical displays that can aid in the identification of persons…

Hierarchical linear modeling (HLM) is often used to estimate the effects of socioeconomic status (SES) on academic achievement at different levels of an educational system. However, if a prior academic achievement measure is missing in a HLM model, biased estimates may occur on the effects of student SES and school SES. Phantom effects describe…

Achieving deeper and permanent learning has always been the focus of teaching force. This purpose is independent of the teaching level or subject matter. Pre-service teachers' lack of interest and inability to connect learning levels are partly cited for their inability to develop this deeper and permanent learning of science concepts. In this…

This study develops a framework to conceptualize the use and evolution of machine learning (ML) in science assessment. We systematically reviewed 47 studies that applied ML in science assessment and classified them into five categories: (a) constructed response, (b) essay, (c) simulation, (d) educational game, and (e) inter-discipline. We compared…

Enzyme-linked immunosorbent assay (ELISA) is a valuable tool in various chemical and biological fields for investigating the presence and quantity of proteins of interest in given samples. The high importance of the assay makes it widely used in biological research and hence a crucial skill to master for up-and-coming scientists. A major…

The Next Generation Science Standards (NGSS) delineate three interrelated dimensions that describe what students should know and how they should engage in science learning. These present significant challenges for assessment because traditional assessments may not be able to capture the ways in which students engage with content. Science…

Classical automated test assembly (ATA) methods assume fixed and known coefficients for the constraints and the objective function. This hypothesis is not true for the estimates of item response theory parameters, which are crucial elements in test assembly classical models. To account for uncertainty in ATA, we propose a chance-constrained…

Multidimensional item response theory (MIRT) models have generated increasing interest in the psychometrics literature. Efficient approaches for estimating MIRT models with dichotomous responses have been developed, but constructing an equally efficient and robust algorithm for polytomous models has received limited attention. To address this gap,…

Teaching physical science has been challenging for educators for quite some time, and with the COVID-19 pandemic, the situation has even worsened which made the adoption of blended learning in the different cycles of education only a matter of time. This paradigm requires nevertheless a certain command when it comes to using some specific tools…

This study explores the use of the Adaptive Neuro-Fuzzy Inference System (ANFIS), a neuro-fuzzy approach, to analyze the log data of technology-based assessments to extract relevant features of student problem-solving processes, and develop and refine a set of fuzzy logic rules that could be used to interpret student performance. The log data that…

Hemolytic disease of the newborn (HDN) is a potentially fatal condition caused by a Rhesus (Rh) antigen incompatibility between a mother and fetus. As a result, determining the Rh status of expectant parents is a routine clinical assessment. Both the physiological and immunological basis of this condition are taught to undergraduate students. At…

This research proposes a new statistic for testing latent variable distribution fit for unidimensional item response theory (IRT) models. If the typical assumption of normality is violated, then item parameter estimates will be biased, and dependent quantities such as IRT score estimates will be adversely affected. The proposed statistic compares…

We introduce an approach for making a quantitative comparison of the item response curves (IRCs) of any two populations on a multiple-choice test instrument. In this study, we employ simulated and actual data. We apply our approach to a dataset of 12,187 participants on the 25-item Science Literacy Concept Inventory (SLCI), which includes ample…

Large-scale assessments (LSAs) use Mislevy's "plausible value" (PV) approach to relate student proficiency to noncognitive variables administered in a background questionnaire. This method requires background variables to be completely observed, a requirement that is seldom fulfilled. In this article, we evaluate and compare the…

As part of the ACS Examinations Institute (ACS-EI) national norming process, student performance data sets are collected from professors at colleges and universities from around the United States. Because the data sets are collected on a volunteer basis, the ACS-EI often receives data sets with only students' total scores and without the students'…