Background: Over the past 20 years, much has been written about the merits and limitations of matching methods, particularly propensity score matching (see, e.g., Stuart, 2010 for a review of matching approaches), and the myriad ways matching can be implemented to identify a comparison group that is similar to the treatment group on observable…

Although inter-rater reliability is an important aspect of using observational instruments, it has received little theoretical attention. In this article, we offer some guidance for practitioners and consumers of classroom observations so that they can make decisions about inter-rater reliability, both for study design and in the reporting of data…

In this paper, I extend the concept of observer effect into the realm of country-level secondary data analysis. When analyzing what appear to be the same secondary data using the same methods, macro-comparative researchers arrive at different results. I argue that this is a product of idiosyncratic variation directly or indirectly produced by the…

This study investigates the relationship between measures of user activity within a Learning Management System (LMS) and student performance during a series of Virtual Field Experience (VFE) online learning modules. Implemented in a graduate-level course on teaching methods for learners with mild/moderate disabilities, each VFE activity was…

Two studies investigated the accuracy of eight different interval-based group observation methods that are commonly used to assess the effects of classwide interventions. In Study 1, a Microsoft Visual Basic program was created to simulate a large set of observational data. Binary data were randomly generated at the student level to represent…

The purpose of this study is to compare satisfaction, self-confidence, and engagement of baccalaureate nursing students using defined observational roles and expectations versus traditional observer role assignments in high fidelity simulation and debriefing and to evaluate student perceptions of these constructs. The NLN/Jeffries Simulation…

This study investigated the effectiveness of a novel inquiry-based instructional sequence using interactive simulations for supporting students' development of conceptual understanding, inquiry process skills and confidence in learning. The study, conducted in Beijing, involved two teachers and 117 students in four classes. The teachers…

Virtual globe programs such as Google Earth replicate real-world experiential learning of spatial and geographic concepts by allowing students to navigate across our planet without ever leaving campus. However, empirical evidence for the learning value of these technological tools and the experience students gain by exploration assignments framed…

Bayesian alternatives to frequentist propensity score approaches have recently been proposed. However, few studies have investigated their covariate balancing properties. This article compares a recently developed two-step Bayesian propensity score approach to the frequentist approach with respect to covariate balance. The effects of different…

Abstract electronics concepts are difficult to develop because the phenomena of interest cannot be readily observed. Visualisation skills support learning about electronics and can be applied at different levels of representation and understanding (observable, symbolic and abstract). Providing learners with opportunities to make transitions…

Observational tutoring has been found to be an effective method for teaching a variety of subjects by reusing dialogue from previous successful tutoring sessions. While it has been shown content can be learned through observational tutoring, it has yet to been examined if a secondary behavior such as goal setting can be influenced. The present…

The purpose of this study was to characterize and compare 64 elementary science teachers' computer simulation use prior to and following professional development (PD) aligned with Innovation Adoption Theory. The PD highlighted computer simulation affordances that elementary teachers might find particularly useful. Qualitative and quantitative…

Two investigations were conducted in this study. In the first experiment, the effects of two types of interactivity with a computer simulation were compared: experimentation versus observation interactivity. Experimentation interactivity allows students to use simulations to conduct virtual experiments, whereas observation interactivity allows…

Initiated in response to informal reports of vocabulary gains from gamers at universities in New Zealand and the Netherlands, this qualitative study explored how English language learners autonomously learn vocabulary while playing massively multiplayer online role-playing games (MMORPGs). Using research processes inherent in Grounded Theory, data…

This comparative case study presents one key challenge that 2 experienced teachers faced when using simulations: control. Simulations are activities that place high demands on teachers, including the ability to anticipate pitfalls in advance, act in multiple capacities, shape the direction of the activity without unduly interfering, and to be…