I. Purpose of the Study: Detecting whether interventions work or not (through main effect analysis) can provide empirical evidence regarding the causal linkage between malleable factors (e.g., interventions) and learner outcomes. In complement, moderation analyses help delineate for whom and under what conditions intervention effects are most…

This paper focuses on the considerations in determining the number of participants for qualitative research because of the lack of clear guidelines in this area. The study has employed a semi-systematic literature review that is embedded with the researcher's experience. The study has concluded that the purpose of the research, methodological…

In this study, we collected mixed method social network data alongside a survey of people who inject drugs (PWID) to assess key assumptions of respondent-driven sampling (RDS). We found adherence to some assumptions and non-adherence to others. Specifically, sampling did occur through a connected network of PWID and the reported degree size of…

Effective educational measurement relies heavily on the curation of well-designed item pools. However, item calibration is time consuming and costly, requiring a sufficient number of respondents to estimate the psychometric properties of items. In this study, we explore the potential of six different large language models (LLMs; GPT-3.5, GPT-4,…

Underrepresentation of socioeconomically, culturally, and/or linguistically diverse (SCLD) children with neurodevelopmental disorders (NDD) and their families has become a focal point for researchers. This systematic review aimed to identify researchers' strategies for recruiting and retaining SCLD families of children with NDD, published between…

When it is required to estimate item parameters of a large item bank, Multiple Matrix Sampling (MMS) design provides an efficient way while minimizing the test burden on students. The current study exemplifies how to calibrate a large item pool using MMS design for various purposes, such as developing a CAT administration. The purpose of the…

Diverse samples are valuable to the study of development, and to psychology more broadly. But convenience samples--typically recruited from local populations close to universities--are still the most widely used in developmental science, despite the fact that their use leads to a vast over-representation of Western, White, and high socio-economic…

Recent metascience suggests that motor behavior research may be underpowered, on average. Researchers can perform a priori power analyses to ensure adequately powered studies. However, there are common pitfalls that can result in underestimating the required sample size for a given design and effect size of interest. Critical evaluation of power…

The social autopsy takes the death of a set of individuals as its starting point and then critically and systematically examines social and political conditions to explain these deaths and generate awareness and policy change. After distinguishing the social autopsy from other means to explain excess and premature deaths, we delineate three core…

The American School District Panel (ASDP) is the newest addition to the RAND Corporation's American Educator Panels (AEP) and was designed to survey district leaders several times each school year. RAND recruits ASDP members using probabilistic sampling methods, which allow researchers to weight survey results to generalize to the national…

Amazon Mechanical Turk (MTurk) is a crowdsourcing website that has become a popular participant recruitment tool in social science research. MTurk provides access to a large, diverse, and inexpensive pool of willing participants, and the unique clinical characteristics of MTurk participants may be of particular interest to rehabilitation…

Two- and three-level designs in educational and psychological research can involve entire populations of Level-3 and possibly Level-2 units, such as schools and educational districts nested within a given state, or neighborhoods and counties in a state. Such a design is of increasing relevance in empirical research owing to the growing popularity…

The current literature on test equating generally defines it as the process necessary to obtain score comparability between different test forms. The definition is in contrast with Lord's foundational paper which viewed equating as the process required to obtain comparability of measurement scale between forms. The distinction between the notions…

The authors of this report provide technical information about the fall 2024 American School District Panel survey of district leaders. This survey was administered to a nationally representative sample of nearly 8,000 K-12 public school districts. The authors describe the survey administration and weighting processes they used to produce…

This paper informs users of data collected in international large-scale assessments (ILSA), by presenting argumentsunderlining the importance of considering two design features employed in these studies. We examine a commonmisconception stating that the uncertainty arising from the assessment design is negligible compared with that arisingfrom the…