This paper aims to identify and compare key factors influencing US States' or an OECD country's decision to employ student test scores or test score value-added (VAM) in evaluating teacher effectiveness. Analysis using multiple linear probability model and logistic regression frameworks indicates that the use of VAM/student test scores was…

This paper expands on previous work on charter school typology and presents disparities in standardized test outcomes across models by using standardized Z-Scores weighted by NAEP performance. Analyses indicate that in ELA, Classical schools have the highest relative performance, followed by Montessori and Art schools. In math, Classical schools…

The present paper investigates and examines the conditional dependencies between cognitive responses (RA; Response Accuracy) and process data, in particular, response times (RT) in large-scale educational assessments. Using two prominent large-scale assessments, NAEP and PISA, we examined the RA-RT conditional dependencies within each item in the…

This article describes a secondary analysis of the National Assessment of Educational Progress 2008 eighth-grade visual arts data (N = 3,912). These assessments occur under government mandate on a periodic schedule and data on the arts were collected in 1997 and again in 2008. The purpose of this study was to predict students' visual art response…

It is a much-lamented fact that research with the potential to inform or influence education policy instead remains policy inert. There are many reasons for this frustrating state of affairs, including a lack of strategic thinking on the part of researchers on how to successfully accomplish outreach--as opposed to communication with peers…

We used the Stanford education data archive (SEDA) data to examine the heterogeneity among urban school districts in the United States. The SEDA 2.1 includes data sets on students' mathematics (Math) and English language arts (ELA) achievement from 2008 to 2014 at the district level. Growth mixture modeling was used to uncover the underlying…

Rural students in Arizona enjoy far more education choice options than rural students in any other state. Education has flourished in rural areas under Arizona's robust choice environment just as much as in the remainder of the state. The data could not be clearer: Rural students with expanded opportunities thrive, as do their teachers and…

Process Analysis is an emerging approach to discover meaningful knowledge from temporal educational data. The study presented in this paper shows how we used Process Analysis methods on the National Assessment of Educational Progress (NAEP) test data for modeling and predicting student test-taking behavior. Our process-oriented data exploration…

Automatic machine learning (AutoML) methods automate the time-consuming, feature-engineering process so that researchers produce accurate student models more quickly and easily. In this paper, we compare two AutoML feature engineering methods in the context of the National Assessment of Educational Progress (NAEP) data mining competition. The…

In August, the National Assessment of Education Progress (NAEP) released the grimmest "Nation's Report Card" in 20 years. Between 2020 and 2022, America's students dropped five points in reading and seven points in math. At a time when there is empirical evidence that America's students are struggling -- the NAEP scores are just one…

The present study examines the features and quality of visual representations (VRs) created by middle school students with learning disabilities and difficulties in mathematics in response to a released fraction item from the National Assessment of Educational Progress (NAEP). Relations between VR quality and scores on other measures of fraction…

In high-stakes, large-scale, standardized tests with certain time limits, examinees are likely to engage in either one of the three types of behavior (e.g., van der Linden & Guo, 2008; Wang & Xu, 2015): solution behavior, rapid guessing behavior, and cheating behavior. Oftentimes examinees do not always solve all items due to various…

Anecdotal evidence points to the importance of school principals, but the limited existing research has neither provided consistent results nor indicated any set of essential characteristics of effective principals. This paper exploits extensive student-level panel data across six states to investigate both variations in principal performance and…

Test score distributions of schools or demographic groups are often summarized by frequencies of students scoring in a small number of ordered proficiency categories. We show that heteroskedastic ordered probit (HETOP) models can be used to estimate means and standard deviations of multiple groups' test score distributions from such data. Because…

Striving to remain a global leader in innovation, the United States continues prioritizing broadening participation in engineering and other STEM fields. For this reason, STEM outreach programs are increasingly popular and vital. However, few programs offer such outreach experiences at a large, national scale and intentionally situate those…