In this dissertation, I explore the idea of designing "flexible game systems". A flexible game system allows players (not software designers) to decide on what rules to enforce, who enforces them, and when. I explore this in the context of digital card games and introduce two design strategies for promoting flexibility. The first…

Though much research and attention has been directed at assessing the correlation coefficient under range restriction, the assessment of reliability under range restriction has been largely ignored. This article uses item response theory to simulate dichotomous item-level data to assess the robustness of KR-20 ([alpha]), [omega], and test-retest…

Transitional Probability (TP) computations are regarded as a powerful learning mechanism that is functional early in development and has been proposed as an initial bootstrapping device for speech segmentation. However, a recent study casts doubt on the robustness of early statistical word-learning. Johnson and Tyler (2010) showed that when…

We study the origins of what has become one of the most radical and encompassing programmes of school reform seen in the recent past amongst advanced countries--the introduction of academy schools to English secondary education. Academies are state schools that are allowed to run in an autonomous manner which is free from local authority control.…

Is the t test statistic for the Pearson Product Moment Correlation Coefficient robust to errors of the second kind? This investigation indirectly measured the effects of power through a type 2 error rate robustness study. The results were revealing. [The dissertation citations contained here are published with the permission of ProQuest LLC.…

We contribute to debate about causal inferences in educational research in two ways. First, we quantify how much bias there must be in an estimate to invalidate an inference. Second, we utilize Rubin's causal model to interpret the bias necessary to invalidate an inference in terms of sample replacement. We apply our analysis to an inference…

Grade inflation impacts university credibility, student courses of study, choices of institution, and other areas. There has been an upward shift in grades without a corresponding upward shift in knowledge gained. Some of the most frequently mentioned causes of grade inflation are: (1) student evaluations of professors; (2) student teacher…

Test-retest data on Super's Work Values Inventory-Revised for a group of predominantly White ("N" = 995) women (mean age = 23.5 years, SD = 8.07) and men (mean age = 21.5 years, SD = 5.80) showed stability in mean-level scores over a period of 1 year for the sample as a whole. However, low raw score and rank order stability coefficients…

A safe environment is a prerequisite for productive learning. This paper represents the first large-scale analysis of how feelings of safety at school affect educational outcomes. Using a unique longitudinal dataset of survey responses from New York City middle school students, the paper provides insight into the causal relationship between…

In recent years, many states have adopted Item Response Theory (IRT) based vertically scaled tests due to their compelling features in a growth-based accountability context. However, selection of a practical and effective calibration/scaling method and proper understanding of issues with possible multidimensionality in the test data is critical to…

The past two decades have shown an unexpected effectiveness of "Web-scale" data in natural language processing. Even the simplest models, when paired with unprecedented amounts of unstructured and unlabeled Web data, have been shown to outperform sophisticated ones. It has been argued that the effectiveness of Web-scale data has…

When students fail an examination at the end of their first year, they are offered a resit examination, which they merely need to pass to progress into the second year. These resits anecdotally provide a dual purpose of testing that students have achieved the required level of attainment to progress, and incentivising additional effort. This paper…

A group of postgraduate accounting and finance students were asked to participate in a three-phase exercise: sit an unseen past examination question; mark a fully anonymised previous student solution (exemplar); and then mark their own work. The marking process was facilitated by explaining and discussing the marking guide, assessment systems and…

While open source software (OSS) emphasizes open access to the source code and avoids the use of formal appropriability mechanisms, there has been little understanding of how the existence and exercise of formal intellectual property rights (IPR) such as patents influence the direction of OSS innovation. This dissertation seeks to bridge this gap…

Replications and robustness checks are key elements of the scientific method and a staple in many disciplines. However, leading journals in developmental psychology rarely include explicit replications of prior research conducted by different investigators, and few require authors to establish in their articles or online appendices that their key…