The relationship between confidence and accuracy has long been an important and controversial topic within the field of human memory. In a recent review article, Schwartz (2024). "Inferential theories of retrospective confidence." Metacognition & Learning.) competently summarized some of the key empirical findings on this issue and…

The multidimensional mixture data structure exists in many test (or inventory) conditions. Heterogeneity also relatively exists in populations. Still, some researchers are interested in deciding to which subpopulation a participant belongs according to the participant's factor pattern. Thus, in this study, we proposed three analysis procedures…

Small sample sizes pose a severe threat to convergence and accuracy of between-group level parameter estimates in multilevel structural equation modeling (SEM). However, in certain situations, such as pilot studies or when populations are inherently small, increasing samples sizes is not feasible. As a remedy, we propose a two-stage regularized…

The present study investigates the influence of multidimensionality on linking and equating in a unidimensional IRT. Two hypothetical multidimensional scenarios are explored under a nonequivalent group common-item equating design. The first scenario examines test forms designed to measure multiple constructs, while the second scenario examines a…

This study examined the relationship between the accuracy of parental reporting of children's sleep duration compared to objectively measured child sleep and tested whether any discrepancies were related to childhood obesity prevalence in a sample of Latinx families (N = 119). A paired sample t-test revealed that parents significantly…

This study aims to compare item and student parameters of dichotomously scored multidimensional constructs estimated based on unidimensional and multidimensional Item Response Theory (IRT) under different conditions of sample size, interdimensional correlation and number of dimensions. This research, conducted with simulations, is of a basic…

Sociologists increasingly face choices among competing algorithms that represent reasonable approaches to the same task, with little guidance in choosing among them. We develop a strategy that uses simulated data to identify the conditions under which different methods perform well and applies what is learned from the simulations to predict which…

In this three-study investigation, we applied various approaches to score drawings created in response to both Form A and Form B of the Torrance Tests of Creative Thinking-Figural (broadly TTCT-F) as well as the Multi-Trial Creative Ideation task (MTCI). We focused on TTCT-F in Study 1, and utilizing a random forest classifier, we achieved 79% and…

Meta-analyses of treatment effects in randomized control trials are often faced with the problem of missing information required to calculate effect sizes and their sampling variances. Particularly, correlations between pre- and posttest scores are frequently not available. As an ad-hoc solution, researchers impute a constant value for the missing…

Prior knowledge is often strongly related to students' learning. In the present research, we explored the relationship between prior knowledge and the accuracy of students' predictive monitoring judgments (judgments of learning; JOLs) and postdictive monitoring judgments (confidence judgments). In four experiments, students completed prior…

How does one assess developmental change when the measures themselves change with development? Most developmental studies of word learning use either looking (infants) or pointing (preschoolers and older). With little empirical evidence of the relationship between the two measures, developmental change is difficult to assess. This paper analyzes…

Objectives: Previous studies have widely demonstrated that inhibition of return (IOR) with audiovisual targets decreases due to audiovisual integration (AVI). It is currently unclear, however, whether the impaired AVI in children with ADHD has effects on IOR. The present study used the cue-target paradigm to explore differences between the IOR of…

Students often make incorrect predictions about their exam performance, with the lowest-performing students showing the greatest inaccuracies in their predictions. The reasons why low-performing students make inaccurate predictions are not fully understood. In two studies, we tested the hypothesis that low-performing students erroneously predict…

Effective educational measurement relies heavily on the curation of well-designed item pools. However, item calibration is time consuming and costly, requiring a sufficient number of respondents to estimate the psychometric properties of items. In this study, we explore the potential of six different large language models (LLMs; GPT-3.5, GPT-4,…

Identifying items with differential item functioning (DIF) in an assessment is a crucial step for achieving equitable measurement. One critical issue that has not been fully addressed with existing studies is how DIF items can be detected when data are multilevel. In the present study, we introduced a Lord's Wald X[superscript 2] test-based…