Purpose: This study, a post hoc observational one, attempted to determine if career and technical education (CTE) students in the state of Mississippi would academically benefit from taking multiple formative assessments in an online format prior to completing their summative exams. Most CTE students in the state of Mississippi are required to…

We investigate two research questions using a recent statewide transition from paper to computer-based testing: first, the extent to which test mode effects found in prior studies can be eliminated; and second, the degree to which online and paper assessments offer different information about underlying student ability. We first find very small…

This study examined the implementation of high-stakes adoption of edTPA® in one state in the year prior to consequential use of edTPA scores for teacher licensure. Using a mixed methods design, we investigated concerns of coordinators who were responsible for edTPA implementation in their institutions. We utilized the Concerns Based Adoption Model…

The Every Student Succeeds Act requires that states make efforts to offer statewide achievement tests in languages, other than English, that are present to a significant extent in the state. Currently, four states offer Spanish reading or language arts assessments as part of their statewide testing program. In these states, practitioners may be…

This report, which is based on an invited presentation given at the 2015 meeting of the Association of Test Publishers, is a response to the continuing proliferation of scale linking studies that have occurred since the publication of "Uncommon Measures" in 1999.The report has four parts. First, I restate the conclusions made in…

State testing programs regularly release previously administered test items to the public. We provide an open-source recipe for state, district, and school assessment coordinators to combine these items flexibly to produce scores linked to established state score scales. These would enable estimation of student score distributions and achievement…

Automated Writing Evaluation (AWE) provides automatic writing feedback and scoring to support student writing and revising. The purpose of the present study was to analyze a statewide implementation of an AWE software (n = 114,582) in grades 4-11. The goals of the study were to evaluate: (1) to what extent AWE features were used; (2) if equity and…

Most students with disabilities participate in state assessments with or without accommodations [based on each student's Individualized Education Program (IEP)]. A small number of students with the most severe or profound intellectual disabilities participate in an alternate assessment based on alternate achievement standards (AA-AAS). Until…

Large-scale performance assessment programs are a longstanding reform tool. However, standard setting can be a challenge for assessment programs that use primarily non-standardized assessments. The purpose of this paper is to extend this field of research by explaining the standard setting methodology applied to one more recent instantiation of a…

This article proposes that sampling design effects have potentially huge unrecognized impacts on the results reported by large-scale district and state assessments in the United States. When design effects are unrecognized and unaccounted for they lead to underestimating the sampling error in item and test statistics. Underestimating the sampling…

Since the passage of No Child Left Behind, large-scale assessments have come to play a central role in federal and state education accountability systems. Teachers and parents have expressed a number of concerns about their state testing programs, such as too much time devoted to testing and the high-stakes use of testing for teacher evaluation.…

Items on test score scales located at and below the Proficient cut score define the content area knowledge and skills required to achieve proficiency. Alternately, examinees who perform at the Proficient level on a test can be expected to be able to demonstrate that they have mastered most of the knowledge and skills represented by the items at…

We describe the results of a study designed to assess knowledge, perceptions, and attitudes towards evidence-based and other prevention programs among county Extension educators. We examined differences across educators from Family and Consumer Sciences (FCS) and 4-H Youth Development. Analyses based on a multi-state sample of educators revealed…

Teachers spend most of their time in school in classrooms, and their instruction and teaching practices may be affected by classroom context such as class size. We examine whether teacher effects interact with classroom context such as class size. Specifically, we seek to determine whether teacher effects are more pronounced in small classes than…

This study evaluated large-scale state writing assessments for the inclusion of motivational characteristics in the writing task and written prompt. We identified 6 motivational variables from the authentic activity literature: time allocation, audience specification, audience intimacy, definition of task, allowance for multiple perspectives, and…