In this study, we explore the application of process mining techniques on assessment log data to explore problem-solving strategies in Algebra. By analyzing sequences of student activities, we demonstrate the significant potential of process mining in identifying problem-solving strategies that lead to successful and unsuccessful outcomes. Our…

The current study expands on previous research on gender differences and similarities in science test scores. Using three different approaches -- differential item functioning, differential distractor functioning, and decision tree analysis -- we examine a high school science assessment administered to 3,849 10th-12th graders, of whom 2,021 are…

When an assessment undergoes changes to the administration or instrument, bridge studies are typically used to try to ensure comparability of scores before and after the change. Among the most common and powerful is the common population linking design, with the use of a linear transformation to link scores to the metric of the original…

When judging subject-specific aspects of students' texts, teachers should assess various characteristics, e.g., spelling and content, independently of one another since these characteristics are indicators of different skills. Independent judgments enable teachers to adapt their classroom instruction according to students' skills. It is still…

In this secondary analysis study, the authors explored the relations between reading comprehension and oral reading performance in fourth-grade students, using a data set from the U.S. National Assessment of Educational Progress (NAEP) special study of oral reading. The data set consisted of 1,713 students randomly selected from the 140,000 fourth…

In this essay, we describe the construction and use of the Cut-Score Operating Function in aiding standard setting decisions. The Cut-Score Operating Function shows the relation between the cut-score chosen and the consequent error rate. It allows error rates to be defined by multiple loss functions and will show the behavior of each loss…

The present study examined the ability of content domain (algebra, geometry, rational number, probability) to classify mathematics misconceptions. The study was conducted with 1,133 students in 53 algebra and geometry classes taught by 17 teachers from three high schools and one middle school across three school districts in a Midwestern state.…

When the National Benchmark Tests (NBTs) were first considered, it was suggested that the results would assess entry-level students' academic and quantitative literacy, and mathematical competence, assess the relationships between higher education entry-level requirements and school-level exit outcomes, provide a service to higher education…

The 3 purposes of this study were to: (a) describe fraction ordering errors among at-risk 4th-grade students; (b) assess the effect of part-whole understanding and accuracy of fraction magnitude estimation on the probability of committing errors; and (c) examine the effect of students' ability to explain comparing problems on the probability of…

The three purposes of this study were to (a) describe fraction ordering errors among at-risk fourth grade students, (b) assess the effect of part-whole understanding and accuracy of fraction magnitude estimation on the probability of committing errors, and (c) examine the effect of students' ability to explain comparing problems on the probability…

Latent regression models are used for score-reporting purposes in large-scale educational survey assessments such as the National Assessment of Educational Progress (NAEP) and Trends in International Mathematics and Science Study (TIMSS). One component of these models is based on item response theory. While there exists some research on assessment…

Large-scale numeracy assessments are intended to facilitate the improvement of educational outcomes; however, it is not clear exactly how this is to be achieved. To move towards the goal of numeracy for all, it is necessary to systematically address issues that are known to be difficult, pervasive and persistent. This paper includes an analysis of…

Teachers all over the world are aware that students struggle with fractional concepts and with elementary algebra. Support for this assertion can be found in a variety of research reports. The National Assessment of Educational Progress (NAEP), a United States report, indicates that students have recurrently demonstrated a lack of proficiency in…

Mathematics and science are important for success in school, but learning mathematics and science can be a difficult task to some students. Efforts to improve students' learning of school mathematics and science have led to reform efforts in curriculum and instruction over the past decades (e.g., National Council of Teachers of Mathematics [NCTM],…

An analysis of the 1990 National Assessment of Educational Progress (NAEP) found that only 46 percent of all high school seniors demonstrated success with a grasp of decimals, percentages, fractions and simple algebra. This article investigates error patterns that emerge as students attempt to answer questions involving the ability to apply…