We examined the variation in Force and Motion Conceptual Evaluation (FMCE) preclass scores according to the type of physics class a student had in high school. This was done for students who had taken Physics 1 at a highly selective university. The majority of students had taken an Advanced Placement (AP) physics course, allowing us to examine in…

The authors examined the relationships of ACT Aspire test scores and high school course grades, AP test scores, and Partnership for Assessment of Readiness for College and Careers (PARCC) test scores, demonstrating criterion-related as well as convergent and discriminant validity evidence. They found that ACT Aspire test scores are strong…

This study examined outcomes for AP® Calculus and AP Physics students on the 2015 Trends in International Math and Science Study (TIMSS) relative to other participating countries and other advanced math and science students in the United States. Compared to other countries in the study, AP Calculus BC and AP Physics C: EM students outperformed all…

This empirical study analyzed data from 638 teachers and 11,800 students in low-socioeconomic status (SES) urban schools (and schools with urban characteristics) exploring associations of school, teacher, teaching, and professional development characteristics toward student performance on the revised Advanced Placement (AP) Biology and AP…

This presentation summarizes a pilot study conducted after the May 2011 administration of the AP Environmental Science Exam. The study used analytical methods based on scaled anchoring as input to a Performance Level Descriptor validation process that solicited systematic input from subject matter experts.

The purpose of this study was to address Advanced Placement (AP)® policy-related questions from administrators at the University System of Georgia (USG) using current AP Exam records and student course performance at four institutions. Specifically, comparisons of sequent or subsequent course grades were made between AP and non-AP students. This…

The Many-Facet Rasch (MFR) Model is traditionally used to evaluate the quality of ratings on constructed response assessments; however, it can also be used to evaluate the quality of judgments from panel-based standard setting procedures. The current study illustrates the use of the MFR Model by examining the quality of ratings obtained from a…

The many-faceted Rasch (MFR) model has been used to evaluate the quality of ratings on constructed response assessments; however, it can also be used to evaluate the quality of judgments from panel-based standard setting procedures. The current study illustrates the use of the MFR model for examining the quality of ratings obtained from a standard…

This article reports on the findings of a recent study that examines one of the most enduring debates in science instruction--whether "depth" or "breadth" of knowledge is most important. Its authors come down on the side of depth. The study found that high school students who focus more intensely on core topics within their…

Mixed-format tests containing both multiple-choice and constructed-response items are widely used on educational tests. Such tests combine the broad content coverage and efficient scoring of multiple-choice items with the assessment of higher-order thinking skills thought to be provided by constructed-response items. However, the combination of…

A new test of Advanced Placement Physics, explicitly designed to balance both content and cognitive-processing skills, was developed using Sternberg's theory of successful intelligence. The test was administered to 281 AP Physics students from 10 schools during the 2006-2007 school year. Six empirically distinguishable profiles of strengths and…

Compares performance of first-year general chemistry college students from 32 institutions with performance of Advanced Placement (AP) Chemistry Candidates in 1978 to provide a concurrent validity measure of the multiple-choice section of the AP chemistry examination. Average AP candidates scored significantly higher than average college students.…

This report builds on and extends existent research on population invariance to new tests and issues. The authors lay the foundation for a deeper understanding of the use of population invariance measures in a wide variety of practical contexts. The invariance of linear, equipercentile and IRT equating methods are examined using data from five…

The accuracy with which expert systems (ESs) score a new nonmultiple-choice free-response test item was investigated, using 734 high school students who were administered an advanced-placement computer science examination. ESs produced scores for 82 percent to 95 percent of the responses and displayed high agreement with a human reader on the…

The increasing use of microcomputers and hand-held calculators has implications for mathematics and science instruction, achievement testing, and educational research. The potential effects of these technologies on curricula involve both content and delivery. In mathematics instruction, the focus may shift from manipulative to higher order skills.…