This article presents design principles and practical steps for web-based Q methodology surveys. Drawing on the experience of two online Q studies, we discuss theoretical concerns, sort and survey design, software programs, and issues in researcher-participant engagement. We argue that opening Q methodology to online modes of data collection is…

This paper discusses some of the recurrent issues which the authors have noticed in educational research. These might be concerned with the nature of social science research, such as its representation of the reality of student learning, the role for replication studies, and the tolerance for disagreements. There are also issues related to the…

We briefly review the emergence of internet research ethics (IRE) since 2000 across three stages, showing how the last, IRE 3.0, focuses on ethical challenges and issues evoked by Big Data. We explore specific examples of IRE 3.0 as occasioned by requirements for informed consent -- including Big Data analyses of a closed Facebook group -- as…

Digital learning platforms (DLPs) are beginning to become open to research. Specifically, in our work in SEERNet, developers are extending five platforms, each used in either K-12 or higher education by more than 100,000 users, to enable third-party researchers to explore, develop, and test improvements. SEERNet seeks to enable equity-relevant…

This article describes the analysis of regression-discontinuity designs (RDDs) using the R packages rdd, rdrobust, and rddtools. We discuss similarities and differences between these packages and provide directions on how to use them effectively. We use real data from the Carolina Abecedarian Project to show how an analysis of an RDD can be…

The field of education is increasingly committed to adopting evidence-based practices. Although randomized experimental designs provide strong evidence of the causal effects of interventions, they are not always feasible. For example, depending upon the research question, it may be difficult for researchers to find the number of children necessary…

This paper provides a guide to calculating statistical power for the complex multilevel designs that are used in most field studies in education research. For multilevel evaluation studies in the field of education, it is important to account for the impact of clustering on the standard errors of estimates of treatment effects. Using ideas from…

The present study adds to the computer-mediated communication (CMC) literature by exploring oral learner-to-learner interaction using Skype, a free and widely used Internet software program. In particular, this task-based study has a two-fold goal. Firstly, it explores possible differences between two modes of oral CMC (audio and video) and…

Over the last decade, Alternate Reality Games (ARGs), a form of narrative often involving multiple media and gaming elements to tell a story that might be affected by participants' actions, have been used in the marketing and promotion of a number of entertainment related products such as films, computer games and music. This paper discusses the…

With the advent of the computer and user-friendly statistical software packages, factor analysis has become accessible to most researchers. However, conventional factor analysis, or R-technique, is only useful for research concerning types or groups of variables. Educational and psychological researchers are often interested in types of people,…

A brief, practical overview of "design effects" (DEFFs) is presented for users of the results of sample surveys. The overview is intended to help such users to determine how and when to use DEFFs and to compute them correctly. DEFFs are needed only for inferential statistics, not for descriptive statistics. When the selections for…

This paper discusses the results of a research project which aimed to capture, analyse and communicate the complex interactions between students, teachers and technology that occur in the classroom. Teachers and researchers used an innovative research design developed through the InterActive Education Project (Sutherland et al., 2003). Video case…

Examines the work of five researchers who have conducted studies of writing with computers or writing with computer-assisted instruction in the following areas: composing with word processing; writing improvement attributed to computers; instructional software; computer networks for writing; and collaborative writing through telecommunications.…

Background: Almost every aspect of modern life is affected in some way by technology. Many people utilize technology from dawn to dusk to communicate; make decisions; reflect, gain, synthesize, evaluate or distribute information, among many other functions. One would be hard pressed to find a single professional, regardless of career field,…

Research over the past 15 years concerning parametric and nonparametric statistics and 10 recently developed nonparametric techniques for testing interactions in experimental design are reviewed. The new nonparametric techniques are robust, powerful, versatile, and easy to compute. A fabricated dataset is used to illustrate the technique. (TJH)