Accurate data extraction is a key component of evidence synthesis and critical to valid results. The advent of publicly available large language models (LLMs) has generated interest in these tools for evidence synthesis and created uncertainty about the choice of LLM. We compare the performance of two widely available LLMs (Claude 2 and GPT-4) for…

Social network research often depends on the willingness of respondents to provide personal information about themselves and alters. Survey design strategies that increase willingness to share this information are necessary for social network research to be feasible, especially when name generators are used for sampling because rosters are…

As our modern world has become increasingly digitalized, various types of data from different data domains are available that can enrich survey data. To link survey data to other sources, consent from the survey respondents is required. This article compares consent to data linkage requests for seven data domains: administrative data, smartphone…

Purpose: The lack of a definite standard for determining the sample size in qualitative research leaves the research process to the initiative of the researcher, and this situation overshadows the scientificity of the research. The primary purpose of this research is to propose a model by questioning the problem of determining the sample size,…

Family income questions in general purpose surveys are usually collected with either a single-question summary design or a multiple-question disaggregation design. It is unclear how estimates from the two approaches agree with each other. The current paper takes advantage of a large-scale survey that has collected family income with both methods.…

Despite recent methodological advances in saturation, guidelines for its estimation in more complex research designs--such as ethnographic studies--have been lacking. We present an accessible, step-by-step approach to empirical assessment of data saturation, tested on a moderately sized ethnographic study with 109 combined direct observations and…

The interaction of quantitative and qualitative methodology in the mixed methods research (MMR) is analysed in a context of distinctions of the meanings between the terms typically used for description, combination, and integration. The interaction in the phases that precede the results, and their interpretation is considered. As an indicator of…

The purpose of this study was to develop and measure the usability of the software prototype of formative assessment in the LMS. This study was applied in terms of research objective and mixed method (qualitative-quantitative) in terms of data collection in which an exploratory sequential mixed methods design was used. In addition, in order to…

This essay describes the design, and subsequent redesign, of the research methods courses included in an Instructional and Performance Technology (IPT) EdD program at a regional comprehensive university in the southeast United States. The program under examination was developed based on the principles of the Carnegie Project for the Education…

Adaptive survey design refers to using targeted procedures to recruit different sampled cases. This technique strives to reduce bias and variance of survey estimates by trying to recruit a larger and more balanced set of respondents. However, it is not well understood how adaptive design can improve data and survey estimates beyond the…

Single-case design is a research methodology that entails repeated measurement to assess the influence of an independent variable on a dependent variable over time. Data collected in this manner are regularly analyzed using visual analysis of data displayed in a linear graph. Although there is agreement regarding critical elements of visual…

Managing and analysing large qualitative datasets pose a particular challenge for researchers seeking a consistent and rigorous approach to qualitative data analysis. This paper describes and demonstrates the development and adoption of a matrix tool to guide the qualitative data analysis of a large sample (N = 122) of interview data. The paper…

Practitioner-focused educational doctoral programs have grown substantially in recent years. Dissertations in Practice (DiPs), which are the culminating research report and evaluation method in these programs, differ from traditional PhD dissertations in their focus on addressing a problem of practice and on connecting theories with practice. As…

Interrupted time series (ITS) studies are frequently used to examine the impact of population-level interventions or exposures. Systematic reviews with meta-analyses including ITS designs may inform public health and policy decision-making. Re-analysis of ITS may be required for inclusion in meta-analysis. While publications of ITS rarely provide…

This systematic literature review critically evaluates 14 empirical studies published over a 14 years span (2006-2019) to answer questions about the models and the effects of transformational school leadership on student academic achievement. The analysis of the related literature utilized vote counting and narrative synthesis to delineate the…