In educational and psychological research, it is common to use latent factors to represent constructs and then to examine covariate effects on these latent factors. Using empirical data, this study applied three approaches to covariate effects on latent factors: the multiple-indicator multiple-cause (MIMIC) approach, multiple group confirmatory…

We compared students' performance on a paper-based test (PBT) and three computer-based tests (CBTs). The three computer-based tests used different test navigation and answer selection features, allowing us to examine how these features affect student performance. The study sample consisted of 9,698 fourth through twelfth grade students from across…

In the present study, two types of curriculum-based measurement (CBM) tools in science, Vocabulary Matching (VM) and Statement Verification for Science (SV-S), a modified Sentence Verification Technique, were compared. Specifically, this study aimed to determine whether the format of information presented (i.e., SV-S vs. VM) produces differences…

In this study, we investigated the value of a concept map marking guide as an alternative formative assessment tool for science teachers to adopt for the topic of energy. Eight high school science teachers marked students' concept maps using an itemized holistic marking guide. Their marking was compared with the researchers' marking and the scores…

We present a new system for automated scoring of graph construction items that address complex science concepts, feature qualitative prompts, and support a range of possible solutions. This system utilizes analysis of spatial features (e.g., slope of a line) to evaluate potential student ideas represented within graphs. Student ideas are then…

In accordance with the federal No Child Left Behind (NCLB) law of 2001, 100% of students were expected to become proficient on state assessments of reading and mathematics by the end of 2013-2014 academic year. Schools that consistently failed to meet the NCLB's Adequate Yearly Progress requirements were subject to penalties. In 2011, the U.S.…

This quasi-experimental study investigated how explicit instruction about multiple modes of representation (MMR) impacted grades 7 (n = 61) and 8 (n = 141) students' learning and multimodal use on end-of-unit assessments. Half of each teacher's (n = 3) students received an intervention consisting of explicit instruction on MMR in science…

Some form of a short interrupted time series (ITS) is often used to evaluate state and national programs. An ITS design with a single treatment group assumes that the pretest functional form can be validly estimated and extrapolated into the postintervention period where it provides a valid counterfactual. This assumption is problematic. Ambiguous…

This study examined the academic performance and preference of students with disabilities for two types of test administration conditions, computer-based testing (CBT) and pencil-and-paper testing (PPT). Data from a large-scale assessment program were used to examine differences between CBT and PPT academic performance for third to eleventh grade…

The TIMSS 2011 International Database includes data for all questionnaires administered as part of the TIMSS 2011 assessment. This supplement contains the international version of the TIMSS 2011 background questionnaires and curriculum questionnaires in the following 10 sections: (1) Fourth Grade Student Questionnaire; (2) Fourth Grade Home…

There are many advantages supporting the use of computers as an alternate mode of delivery for high stakes testing: cost savings, increased test security, flexibility in test administrations, innovations in items, and reduced scoring time. The purpose of this study was to determine if the use of computers as the mode of delivery had any…

This study examines eighth grade students' use of a representational metaphor (cups and tiles) for writing and solving equations in one unknown. Within this study, we focused on the obstacles and difficulties that students experienced when using this metaphor, with particular emphasis on the operations that can be meaningfully represented through…

Students with disabilities have traditionally achieved to a lesser degree than have their nondisabled peers. Since the 1950s the federal government has enacted laws to provide free, appropriate public education to students with disabilities. In the first decade of the 21st; Century the government has produced legislation requiring schools to be…

Learning Disabilities (LDs) affect a significant number of students in elementary and secondary school. In order for these students, along with parents and teachers, to understand the nature of their specific difficulties, and have equal opportunity in academic settings, a comprehensive psychological report containing properly informed…

Performance-based accountability along with budget tightening has increased pressure on publicly funded organizations to develop and deliver programs that produce meaningful social benefits. As a result, there is increasing need to undertake formative evaluations that estimate preliminary program outcomes and identify promising program components…