We assessed whether an adaptation of value-added analysis (VAA) can provide evidence on the relative effectiveness of interventions implemented in a large school district. We analyzed two datasets, one documenting interventions received by underperforming students, and one documenting interventions received by students in schools benefiting from…

This article-format dissertation focuses on how scholars use social media to support their scholarship. The first article is a scoping literature review that outlines current research. While overviewing an emergent field of literature, the article highlights motivations for using social media use, discusses benefits and drawbacks of this use for…

We assessed whether an adaptation of value-added analysis (VAA) can provide evidence on the relative effectiveness of interventions implemented in a large school district. We analyzed two datasets, one documenting interventions received by underperforming students, and one documenting interventions received by students in schools benefiting from…

A growing literature uses value-added (VA) models to quantify principals' contributions to improving student outcomes. Principal VA is typically estimated using a connected networks model that includes both principal and school fixed effects (FE) to isolate principal effectiveness from fixed school factors that principals cannot control. While…

When using multiple imputation, users often want to know how many imputations they need. An old answer is that 2-10 imputations usually suffice, but this recommendation only addresses the efficiency of point estimates. You may need more imputations if, in addition to efficient point estimates, you also want standard error (SE) estimates that would…

Large-scale analyses are a powerful and increasingly common tool for investigating a range of public health and social concerns (Pienta, O'Rourke, & Franks, 2011). This series will provide a primer on large-scale secondary analysis in school psychology, with this article focusing on considerations for researchers interested in applying and…

The purpose of this study was to compare 12 commonly-used nonoverlap methods with each other and with the results of visual analysis. Data were obtained from 25 studies focused on embedded instruction and schema-based instruction and included a total of 101 graphs. Treatment effect estimates using 12 nonoverlap methods were calculated for each…

Missing data result in less precise and possibly biased effect estimates in single studies. Bias arising from studies with incomplete outcome data is naturally propagated in a meta-analysis. Conventional analysis using only individuals with available data is adequate when the meta-analyst can be confident that the data are missing at random (MAR)…

As California invests in early learning and care, the state is also moving forward with a long-overdue plan to build a statewide longitudinal data system (SLDS) -- known as the Cradle-to-Career (C2C) Data System -- which will eventually connect data over time and across sectors like education, health, human services, and the workforce. This is a…

Due to the precautionary measures during the COVID-19 pandemic many universities offered unproctored take-home exams. We propose methods to detect potential collusion between students and apply our approach on event log data from take-home exams during the pandemic. We find groups of students with suspiciously similar exams. In addition, we…

Altmetrics are non-traditional metrics that can capture downloads, social media shares, and other modern measures of research impact and reach. Despite most of the altmetrics literature focusing on evaluating the relationship between research outputs and academic impact/influence, the perceived and actual value of altmetrics among academicians…

Background: The sudden growth in online instruction due to COVID-19 restrictions has given renewed urgency to questions about remote learning that have remained unresolved. Web-based assessment software provides instructors an array of options for varying testing parameters, but the pedagogical impacts of some of these variations has yet to be…

Encouraging teachers to reflect on their instructional practices and course design has been shown to be an effective means of improving instruction and student learning. However, the process of encouraging reflection is difficult; reflection requires quality data, thoughtful analysis, and contextualized interpretation. Because of this, research on…

The purpose of this paper is to extend and evaluate methods of "Bayesian historical borrowing" applied to longitudinal data with a focus on parameter recovery and predictive performance. Bayesian historical borrowing allows researchers to utilize information from previous data sources and to adjust the extent of borrowing based on the…

Intelligent assessment, the core of any AI-based educational technology, is defined as embedded, stealth and ubiquitous assessment which uses intelligent techniques to diagnose the current cognitive level, monitor dynamic progress, predict success and update students' profiling continuously. It also uses various technologies, such as learning…