Recent developments in the field of artificial intelligence allow for improved performance in the automated assessment of extended response items in mathematics, potentially allowing for the scoring of these items cheaply and at scale. This study details the grand prize-winning approach to developing large language models (LLMs) to automatically…

In 2017, the mathematics assessments that are part of the National Assessment of Educational Progress (NAEP) program underwent a transformation shifting the administration from paper-and-pencil formats to digitally-based assessments (DBA). This shift introduced new interactive item types that bring rich process data and tremendous opportunities to…

Due to the growing importance of technology and engineering in the educational landscape, and to support America's ability to contribute to and compete in a global economy, the National Assessment Governing Board (NAGB) initiated development of the first NAEP Technology and Engineering Literacy (TEL) Assessment. Relating to national efforts in…

This paper describes a study intended to demonstrate how an emerging skill, problem solving with technology, might be measured in the National Assessment of Educational Progress (NAEP). Two computer-delivered assessment scenarios were designed, one on solving science-related problems through electronic information search and the other on solving…

In assessing the quality of science teaching for an effort such as the National Assessment of Educational Progress (NAEP), it is important to understand what is meant by scientific thinking--the search for explanations. Instruction should involve higher-order cognitive skill development, but it is difficult to measure reasoning and understanding…

Discusses the need for researchers to determine what should be tested and how when evaluating educational computing programs, describes efforts of Educational Testing Service's National Assessment of Educational Progress (NAEP) to measure the impact of computers on achievement, and concludes that it will not be easy to evaluate computers' effects.…

Data from the 1977-78 mathematics assessment of the National Assessment of Educational Progress (NAEP) on the use of calculators are discussed. (MP) Aspect of National Assessment (NAEP) dealt with in this document: Results (Interpretation).

Results of the second mathematics assessment of the National Assessment of Educational Progress (NAEP) are analyzed with regard to the performance of 13- and 17-year-olds on probability exercises. The results suggest that this area has been neglected in mathematics instruction. (MP)

In the 21st century, the population will need to possess basic skills in the areas of communication and higher problem-solving as well as have scientific and technological literacy; however, results from assessments by the National Assessment of Educational Progress (NAEP) have indicated weak student performance in the area of thinking skills,…

The results of exercises related to fractions on the National Assessment of Educational Progress (NAEP) for 9- and 13-year-olds are reported. This discussion is followed by suggestions on ways to help students be more successful when adding fractions. (MP)

This brief report highlights findings from the two assessments in mathematics and three assessments in science conducted by the National Assessment of Educational Progress between 1969 and 1978. In mathematics, average scores declined during the mid-1970s, especially on problem solving. In science, students generally declined in knowledge, skills,…

Results from the third national mathematics assessment are presented. Overall, the performance of nine year olds changed little since the second assessment, while significant gains were made by 13 year olds. Data on whole numbers, fractions and decimals, other basic concepts, and problem solving are discussed. (MNS)

Open-ended individually administered questions can ascertain whether students can reason about arithmetic problems. Free response test items are useful in assessing students' thought processes as they solve mathematics story problems. Since story problems do not state explicitly which arithmetic operations are required for solution, students must…

This publication provides a comprehensive interpretation of the second mathematics assessment completed during the 1977-78 school year by the National Assessment of Educational Progress (NAEP). The NAEP results suggest strong implications for the mathematics curriculum of the 1980's that mathematics educators need to evaluate with care. The…

Results from the third national mathematics assessment indicate that the decline in performance of 17 year olds between 1973 and 1978 has leveled out over the last four years, and 13 year olds' performance improved significantly between 1978 and 1982. However, most gains were on lower-order skills. (MNS)