Accurate data extraction is a key component of evidence synthesis and critical to valid results. The advent of publicly available large language models (LLMs) has generated interest in these tools for evidence synthesis and created uncertainty about the choice of LLM. We compare the performance of two widely available LLMs (Claude 2 and GPT-4) for…

Social network research often depends on the willingness of respondents to provide personal information about themselves and alters. Survey design strategies that increase willingness to share this information are necessary for social network research to be feasible, especially when name generators are used for sampling because rosters are…

As our modern world has become increasingly digitalized, various types of data from different data domains are available that can enrich survey data. To link survey data to other sources, consent from the survey respondents is required. This article compares consent to data linkage requests for seven data domains: administrative data, smartphone…

Purpose: The lack of a definite standard for determining the sample size in qualitative research leaves the research process to the initiative of the researcher, and this situation overshadows the scientificity of the research. The primary purpose of this research is to propose a model by questioning the problem of determining the sample size,…

Family income questions in general purpose surveys are usually collected with either a single-question summary design or a multiple-question disaggregation design. It is unclear how estimates from the two approaches agree with each other. The current paper takes advantage of a large-scale survey that has collected family income with both methods.…

Collecting data for an individual participant data meta-analysis (IPDMA) project can be time consuming and resource intensive and could still have insufficient power to answer the question of interest. Therefore, researchers should consider the power of their planned IPDMA before collecting IPD. Here we propose a method to estimate the power of a…

This paper describes, and lays out an argument for, the use of a procedure to help groups of reviewers to judge the quality of prior research reports. It argues why such a procedure is needed, and how other existing approaches are only relevant to some kinds of research, meaning that a review or synthesis cannot successfully combine quality…

Despite recent methodological advances in saturation, guidelines for its estimation in more complex research designs--such as ethnographic studies--have been lacking. We present an accessible, step-by-step approach to empirical assessment of data saturation, tested on a moderately sized ethnographic study with 109 combined direct observations and…

The interaction of quantitative and qualitative methodology in the mixed methods research (MMR) is analysed in a context of distinctions of the meanings between the terms typically used for description, combination, and integration. The interaction in the phases that precede the results, and their interpretation is considered. As an indicator of…

The purpose of this study was to develop and measure the usability of the software prototype of formative assessment in the LMS. This study was applied in terms of research objective and mixed method (qualitative-quantitative) in terms of data collection in which an exploratory sequential mixed methods design was used. In addition, in order to…

This essay describes the design, and subsequent redesign, of the research methods courses included in an Instructional and Performance Technology (IPT) EdD program at a regional comprehensive university in the southeast United States. The program under examination was developed based on the principles of the Carnegie Project for the Education…

Adaptive survey design refers to using targeted procedures to recruit different sampled cases. This technique strives to reduce bias and variance of survey estimates by trying to recruit a larger and more balanced set of respondents. However, it is not well understood how adaptive design can improve data and survey estimates beyond the…

Single-case design is a research methodology that entails repeated measurement to assess the influence of an independent variable on a dependent variable over time. Data collected in this manner are regularly analyzed using visual analysis of data displayed in a linear graph. Although there is agreement regarding critical elements of visual…

The system architecture of big data in massive open online courses (BD-MOOCs System Architecture) is composed of six components. The first component was comprised of big data tools and technologies such as Hadoop, YARN, HDFS, Spark, Hive, Sqoop, and Flume. The second component was educational data science, which is composed of the following four…

Managing and analysing large qualitative datasets pose a particular challenge for researchers seeking a consistent and rigorous approach to qualitative data analysis. This paper describes and demonstrates the development and adoption of a matrix tool to guide the qualitative data analysis of a large sample (N = 122) of interview data. The paper…