Qualitative thematic analysis is a commonly used and widely applicable form of qualitative analysis, though it can be challenging to implement. Due to its use across research questions, qualitative traditions, and fields, thematic analysis is also prevalent in mixed methods studies. Despite its widespread use, the term "thematic…

Moving Beyond the Ordinal Methodological Controversy: A Systematic Review (Manuscript 1): Ordinal outcome data is a common byproduct of education research. Yet more than seventy-five years after the development of Stevens' original measurement framework, the permissibility of select analytic techniques to ordinal outcome data remains a topic of…

Meta-analysis of diagnostic test accuracy (DTA) is a powerful statistical method for synthesizing and evaluating the diagnostic capacity of medical tests and has been extensively used by clinical physicians and healthcare decision-makers. However, publication bias (PB) threatens the validity of meta-analysis of DTA. Some statistical methods have…

Evaluators are often called upon to assess the effects of programs. To assess a program effect, evaluators need a clear understanding of how a program effect is defined. Arguably, the most widely used definition of a program effect is the counterfactual one. According to the counterfactual definition, a program effect is the difference between…

Missing data in scientific research go hand in hand with assumptions about the nature of the missingness. When dealing with missing values, a set of beliefs has to be formulated about the extent to which the observed data may also hold for the missing parts of the data. It is vital that the validity of these missingness assumptions is verified,…

Background: Views can be collected from individuals (self-report) or others on their behalf (proxy-report). Objective: We aimed to review the literature on methods and statistical approaches used to evaluate observer versus self-report responses from individuals with intellectual disability or Down syndrome. Methods: A series of key questions…

Research studies in Educational Data Mining (EDM) often involve several variables related to student learning activities. As such, it may be necessary to run multiple statistical tests simultaneously, thereby leading to the problem of multiple comparisons. The Benjamini-Hochberg (BH) procedure is commonly used in EDM research to address this…

The purpose of this article is to provide researchers with a framework for promoting high quality mixed methods school-based consultation research. Furthermore, this article is intended for researchers and practitioners interested in evaluating their practice. To meet these objectives, we address quality criteria for quantitative (validity) and…

Quality assessment systems have recently expanded, serving as indicators for the assessment and ranking of higher education institutions worldwide. The growing development of new educational methodologies, like Blended Learning, requires the design and validation of tools that allow for their assessment. The objective of this article is to…

Experimental psychology is witnessing an increase in research on individual differences, which requires the development of new tasks that can reliably assess variations among participants. To do this, cognitive researchers need statistical methods that many researchers have not learned during their training. The lack of expertise can pose…

Cross-validation is a common statistical procedure applied to problems that are otherwise computationally intractable. It is often employed to assess the effectiveness of prediction procedures. In this report, cross-validation is discussed in terms of "U"-statistics. This approach permits consideration of the statistical properties of…

This study aimed to examine authentic models of science assessment in assessing the competence of senior high school students who met the criteria of validity, practicality, and effectiveness. The methodology applied was an evaluation and developmental research. Research was conducted in senior high school in accordance with the needs of the…

In evaluating the learning achievement of programming-thinking skills, the method of using a rubric that describes evaluation items and evaluation stages is widely employed. However, few studies have evaluated the reliability, validity, and consistency of the rubrics themselves. In this study, we introduced a statistical method for evaluating the…

Cognitive diagnosis models (CDMs) are latent class multidimensional statistical models that help classify people accurately by using a set of discrete latent variables, commonly referred to as attributes. These models require a Q-matrix that indicates the attributes involved in each item. A potential problem is that the Q-matrix construction…

Introduction: The purpose of this paper is to propose a methodology to conceptualize, operationalize, and empirically validate the concept of information need. Method: The proposed methodology makes use of both qualitative and quantitative perspectives, and includes a broad array of approaches such as literature reviews, expert opinions, focus…