The reliability of a test score is usually underestimated and the deflation may be profound, 0.40 - 0.60 units of reliability or 46 - 71%. Eight root sources of the deflation are discussed and quantified by a simulation with 1,440 real-world datasets: (1) errors in the measurement modelling, (2) inefficiency in the estimator of reliability within…

With limited budgets and increasing enrollment demands, colleges need fast, free, and practical solutions supporting academic success and retention. The Academic Reality Check (ARC) tool helps to predict traditional freshmen awareness of their own academic expectations in college quickly, supporting the financial investment being made by all…

Mathematical language (or the content-specific words in mathematics) has repeatedly shown to be related to mathematical abilities in preschool and in the early grades of primary education. Research in this field has predominantly focused on young children's quantitative and spatial language. At the same time, recent research has discovered that…

Recent years have seen a growing number of studies investigating the accuracy of nonprobability online panels; however, response quality in nonprobability online panels has not yet received much attention. To fill this gap, we investigate response quality in a comprehensive study of seven nonprobability online panels and three probability-based…

This study develops a theoretical model for the costs of an exam as a function of its duration. Two kind of costs are distinguished: (1) the costs of measurement errors and (2) the costs of the measurement. Both costs are expressed in time of the student. Based on a classical test theory model, enriched with assumptions on the context, the costs…

A large-scale simulation study of the assessment effectiveness of a particular instantiation of knowledge space theory is described. In this study, data from more than 700,000 actual assessments in mathematics using the ALEKS (Assessment and LEarning in Knowledge Spaces) software were used to determine response probabilities for the same number of…

This study aimed to test the reliability of the Perceived Severity and Response to Bullies and Victims of Bullying Questionnaire (PSRBVBQ) for middle school teachers (N=322 teachers), using exploratory factor analysis and reliability analysis. PSRBVBQ assesses teachers' responses to bullying using situational scenarios. It includes two vignettes…

This article considers how a handicapping system should be devised for squash. It looks at the American scoring system, and whether it is possible to have a fair system of handicapping. We consider "fair" from a perspective of expected number of rallies won and probability of winning.

Evaluating the effects of the Coronavirus (COVID-19) pandemic on distance education applications in higher education is important for future practice. In this context, the aim of the study is to determine preservice mathematics teachers' conceptual-procedural knowledge level competencies and general thoughts about distance education in the…

This study contributes to validity studies by determining the cut-off point of an inventory measuring university students' anxiety levels with Angoff, ROC, and Borderline methods and by examining high/low anxiety levels according to these methods point. The study is regarded as a basic research due to the newly-added data in a multi-scoring…

Psychometric meta-analyses and reviews were provided for four commonly used suicidal ideation instruments: the Beck Scale for Suicide Ideation, the Suicide Ideation Questionnaire, the Suicide Probability Scale, and Columbia--Suicide Severity Rating Scale. Practical and technical issues and best use recommendations for screening and outcome…

We present a multiple-choice test, the Montana State University Formal Reasoning Test (FORT), to assess college students' scientific reasoning ability. The test defines scientific reasoning to be equivalent to formal operational reasoning. It contains 20 questions divided evenly among five types of problems: control of variables, hypothesis…

The goal of the present study is to examine the stability of time attitudes profiles across a one-year period as well as the association between time attitudes profiles and several variables. These variables include attitudes towards alcohol, context of alcohol use, consumption of a full drink, and subjective life expectancy. We assessed the…

Classification consistency and accuracy are viewed as important indicators for evaluating the reliability and validity of classification results in cognitive diagnostic assessment (CDA). Pattern-level classification consistency and accuracy indices were introduced by Cui, Gierl, and Chang. However, the indices at the attribute level have not yet…

Students of all ages face severe conceptual difficulties regarding key aspects of evolution-- the central, unifying, and overarching theme in biology. Aspects strongly related to abstract "threshold" concepts like randomness and probability appear to pose particular difficulties. A further problem is the lack of an appropriate instrument…