However, although existing models for evaluating the effectiveness of universities provide a large number of modeling solutions, it is difficult to objectively evaluate dynamic coefficients based on the differences in precision ideological and political work systems of different types of universities in the evaluation process of innovative paths…

The paradigm on which a methodological approach is developed determines the situations in which its application will be most appropriate. The quantitative approach implies a positivist paradigm, the basis of which is cause-and-effect relationships, as well as the questioning and verifying of existing theories. Positivism aims to prove that…

Meta-analytic models for dependent effect sizes have grown increasingly sophisticated over the last few decades, which has created challenges for a priori power calculations. We introduce power approximations for tests of average effect sizes based upon several common approaches for handling dependent effect sizes. In a Monte Carlo simulation, we…

Common response-time-based approaches for non-effortful response behavior (NRB) in educational achievement tests filter responses that are associated with response times below some threshold. These approaches are, however, limited in that they require a binary decision on whether a response is classified as stemming from NRB; thus ignoring…

This article argues that Agent-Based Modelling, owing to its capabilities and methodology, has a distinctive contribution to make to delivering coherent social science prediction. The argument has four parts. The first identifies key elements of social science prediction induced from real research across disciplines, thus avoiding a straw person…

Social scientists have frequently sought to understand the distinct effects of age, period, and cohort, but disaggregation of the three dimensions is difficult because cohort = period - age. We argue that this technical difficulty reflects a disconnection between how the cohort effect is conceptualized and how it is modeled in the traditional…

Participatory modeling (PM) is an engaged research methodology for creating analog or computer-based models of complex systems, such as socio-environmental systems. Used across a range of fields, PM centers stakeholder knowledge and participation to create more internally valid models that can inform policy and increase engagement and trust…

Thinking about knowledge and knowing ("i.e.", epistemic cognition) is an important part of student learning and has implications for how they apply their knowledge in future courses, careers, and other aspects of their lives. Three classes of models have emerged from research on epistemic cognition: developmental models, dimensional…

Background & Context: Intersectionality theory posits that each individual's unique intersection of identity is integral to understanding their lived experience. Intersectionality theory also understands that social positions interact with oppression to influence an individual's lived experience (Bowleg, 2012; Collins, 2007; Crenshaw, 1989).…

Meta-analysis is a statistical method that combines quantitative findings from previous studies. It has been increasingly used to obtain more credible results in a wide range of scientific fields. Combining the results of relevant studies allows researchers to leverage study similarities while modeling potential sources of between-study…

Despite the rising popularity of big data, there is speculation that evaluators have been slow adopters of these new statistical approaches. Several possible reasons have been offered for why this is the case: ethical concerns, institutional capacity, and evaluator capacity and values. In this method note, we address one of these barriers and aim…

Background: While governments draw on survey data to inform policy choices, the design, application, and interpretation of surveys can generate certain images of disability and ignore many others. Aims and objectives: This article draws attention to social circumstances of people with disabilities often unacknowledged in research evidence: hidden…

We conducted a qualitative content analysis on counseling dissertations (N = 250) completed between 2017 and 2018. Identified categories included: (1) paradigms, philosophies of science, and theories; (2) research methodologies; and (3) trustworthiness. The results indicated an infrequent use of paradigmatic frameworks and a distinct pattern of…

This paper discusses methodological challenges in researching practice. The primary challenge discussed arises from the view that practice is inextricable from its performance, and that performance is embedded in social relations, material infrastructures and historical context. The paper argues for a philosophical hermeneutics approach that works…

At present, there are relatively few international studies that reflect research in religious didactics from a metatheoretical perspective. Against this background, the fundamental question of this contribution is whether there are research designs that are typical for research in religious didactics. For this purpose, research was conducted for a…