This paper presents best practices for conducting survey research using Amazon Mechanical Turk (MTurk). Readers will learn the benefits, limitations, and trade-offs of using MTurk as compared to other recruitment services, including SurveyMonkey and Qualtrics. A synthesis of survey design guidelines along with a sample survey are presented to help…

Short comparative interrupted times series (CITS) designs are increasingly being used in education research to assess the effectiveness of school-level interventions. These designs can be implemented relatively inexpensively, often drawing on publicly available data on aggregate school performance. However, the validity of this approach hinges on…

The goal of this paper is to provide guidance for applied education researchers in using multi-level data to study the effects of interventions implemented at the school level. Two primary approaches are currently employed in observational studies of the effect of school-level interventions. One approach employs intact school matching: matching…

This paper includes a nontechnical description of methods for calculating effect sizes in intellectual and developmental disability studies. Different hypothetical studies are used to illustrate how null hypothesis significance testing (NHST) and effect size findings can result in quite different outcomes and therefore conflicting results. Whereas…

The sophisticated analytical techniques available to institutional researchers give them an array of procedures to estimate a causal effect using observational data. But as many quantitative researchers have discovered, access to a wider selection of statistical tools does not necessarily ensure construction of a better analytical model. Moreover,…

Bullying is one type of violence that threatens a youth's well-being in schools and neighborhoods. The impacts of bullying are felt by individuals, families, schools, and society and may result in youths feeling powerless, intimidated, and humiliated by the aggressive acts of other youth(s). This document is designed as a tool to help…

Since 2004, IPEDS data has been diffused via a product known as the Data Feedback Report (DFR). Produced yearly for each institution in the IPEDS universe, the DFR is a print product that contrasts the IPEDS data submitted by an institution with its institutionally-defined comparison group. The DFR is free to all users, covers a wide range of…

The purpose of this paper is to offer an analytic perspective to policy makers and educational practitioners regarding how to use longitudinal achievement data to evaluate schools. The authors further discuss the potential practical applications of their models for superintendents, researchers, and policy makers. The premise of the study is that…

The "2011 State Preschool Yearbook" is the newest edition of our annual report profiling state-funded prekindergarten programs in the United States. This latest "Yearbook" presents data on state-funded prekindergarten during the 2010-2011 school year as well as documenting a decade of progress since the first…

Data on disfluencies in the speech of non-stuttering adults are relevant to several aspects of the assessment and treatment of adults who stutter. Currently, very few sources provide relevant data. In the existing literature on normally fluent speakers, there is no consistency in sample length or topic or in which types of disfluency are counted.…

The design and use of a chemistry practice exam instrument that includes a measure for student mental effort is described in this paper. Use of such an instrument can beneficial to chemistry students and chemistry educators as well as chemical education researchers from both a content and cognitive science perspective. The method for calculating…

Background/Context: Many children of immigrants are not enrolled in high schools that sufficiently meet their needs, and subsequently, many are not making a successful transition to, and/or successfully completing, higher education. As immigration grows in the United States, educators and policy makers must understand how the educational processes…

Across many areas of psychology, concordance is commonly used to measure the (intragroup) agreement in ranking a number of items by a group of judges. Sometimes, however, the judges come from multiple groups, and in those situations, the interest is to measure the concordance between groups, under the assumption that there is some within-group…

The "2010 State Preschool Yearbook" is the eighth in a series of annual reports profiling state-funded prekindergarten programs in the United States. This latest Yearbook presents data on state-funded prekindergarten during the 2009-2010 school year. The first report in this series focused on programs for the 2001-2002 school year and…

The interpretation of a Thurstonian model for paired comparisons where the utilities' covariance matrix is unrestricted proved to be difficult due to the comparative nature of the data. We show that under a suitable constraint the utilities' correlation matrix can be estimated, yielding a readily interpretable solution. This set of identification…