Criteria are briefly proposed for final conclusions, research problems, and research hypotheses in quantitative research. Moreover, based on a proposed definition of applied and basic/general research, it is argued that (1) in applied quantitative research, while research problems are necessary, research hypotheses are unjustified, and that (2) in…

Educational research enquiries differ based on philosophical beliefs and assumptions regarding researchers' explicitly stated views. This paper critically explores the most dominant philosophical stances in social research sciences, namely positivism, interpretivism and pragmatism. It begins with an overview of the role of the aforementioned…

Due to the nature of collaborative learning, realising perfectly controlled experiments often requires an unreasonable amount of resources and sometimes it is not possible at all. Against this background, I propose to augment as good as feasible experimental design with a nomological net of relations between instructional support (intervention),…

Background/Context: Principles of evidential reasoning have often been discussed in the context of educational and psychological measurement with respect to construct validity and validity arguments. More recently, Mislevy proposed the metaphor of assessment as an evidentiary argument about students' learning and abilities given their…

The motivation for this paper is the authors' recent work on several randomized control trials in which they found the primary result, which averaged across subgroups or sites, to be moderated by demographic or site characteristics. They are led to examine a distinction that the Institute of Education Sciences (IES) makes between "confirmatory"…

The purpose of this study was to assess some of the effects of a nontraditional, experimental learning approach designed to improve rapid acquisition and long-term retention of quantitative communication skills (QCS) such as descriptive and inferential statistics, hypothesis formulation, experimental design, data characteristics, and data…

The reciprocal exchange of employees' work for pay that is central to employment relationships is viewed here through the lens of the psychological contract. A psychological contract involves promised inducements, promised contributions, delivered inducements, and delivered contributions: How an employee cognitively integrates these 4 elements is…

The sense that replicability is an important aspect of empirical science led Killeen (2005a) to define "p[subscript rep]," the probability that a replication will result in an outcome in the same direction as that found in a current experiment. Since then, several authors have praised and criticized 'p[subscript rep]," culminating…

This paper reports a systematic literature review examining empirical studies on the effects of peer assessment for learning. Peer assessment is fundamentally a social process whose core activity is feedback given to and received from others, aimed at enhancing the performance of each individual group member and/or the group as a whole. This makes…

This paper analyzes three possible research designs using each of the four types of sums of squares in the Statistical Package for the Social Sciences (SPSS). When the design is balanced (i.e., each cell has the same number of observations), all of the SPSS types of sums of squares yield equivalent results (testable hypotheses and sums of squares)…

It is suggested that Levy's procedure for testing predicted trends in independent correlations should not produce grossly incorrect inferences when one is dealing with the sorts of correlations which are ordinarily encountered in empirical research. (Author/JKS)

We focus on the problem of ignoring statistical independence. A binomial experiment is used to determine whether judges could match, based on looks alone, dogs to their owners. The experimental design introduces dependencies such that the probability of a given judge correctly matching a dog and an owner changes from trial to trial. We show how…

Two Monte Carlo studies were conducted to examine the sensitivity of goodness of fit indexes to lack of measurement invariance at 3 commonly tested levels: factor loadings, intercepts, and residual variances. Standardized root mean square residual (SRMR) appears to be more sensitive to lack of invariance in factor loadings than in intercepts or…

The validity conditions for univariate repeated measures designs are described. Attention is focused on the sphericity (equality of variance) requirement. It is recommended that separate rather than pooled error term procedures be routinely used to test a priori hypotheses. (Author/JKS)

A Monte Carlo study extended the research of MacKinnon, Lockwood, Hoffman, West, and Sheets (2002) for single-level designs by examining the statistical performance of four methods to test for mediation in a multilevel experimental design. The design studied was a two-group experiment that was replicated across several sites, included a single…