We developed the Physics Inventory of Quantitative Literacy (PIQL) to assess students' quantitative reasoning in introductory physics contexts. The PIQL includes several "multiple-choice-multipleresponse" (MCMR) items (i.e., multiple-choice questions for which more than one response may be selected) as well as traditional single-response…

This research goal to develop a multiple-choice closed-ended test to assessing and evaluate students' digital literacy skills. The sample in this study were students at MTsN 1 Blitar City who were selected using a purposive sampling technique. The test was also validated by experts, namely 2 Doctors of Physics and Science from Yogyakarta State…

Speeded tests set time limits so that few examinees can reach all items, and power tests allow most test-takers sufficient time to attempt all items. Educational achievement tests are sometimes described as "timed power tests" because the amount of time provided is intended to allow nearly all students to complete the test, yet this…

This classroom experiment investigates the effects of adding representational pictures to multiple-choice and constructed-response test items to understand the role of the response format for the multimedia effect in testing. Participants were 575 fifth- and sixth-graders who answered 28 science test items--seven items in each of four experimental…

The purpose of the present article was to illustrate, using an example from a national assessment, the value from analyzing the behavior of distractors in measures that engage the multiple-choice format. A secondary purpose of the present article was to illustrate four remedial actions that can potentially improve the measurement of the…

Does correctly answering a test question about a multiterm fact enhance memory for the entire fact? We explored that issue in 4 experiments. Subjects first studied Advanced Placement History or Biology facts. Half of those facts were then restudied, whereas the remainder were tested using "5 W" (i.e., "who, what, when, where",…

Energy is a core concept in the teaching of science. Therefore, it is important to know how students' thinking about energy develops so that elementary, middle, and high school students can be appropriately supported in their understanding of energy. This study tests the validity of a proposed theoretical model of students' growth of understanding…

In view of the perceived difficulty of organic chemistry unit for high schools students, this study examined the usefulness of concept mapping as a testing device to assess students' difficulty in the select areas. Since many tests used for identifying students misconceptions and difficulties in school subjects are observed to favour one or the…

Education policy in the U.S. in the last two decades has emphasized large-scale assessment of students, with growing consequences for schools, teachers, and students. Given the high stakes of such tests, it is important to understand the relationships between students' answers to test items and their knowledge and skills in the tested content…

This concise guide to objective testing, prepared by the Centre for Studies in Science Education at the University of Leeds, is intended as a manual for those science teachers who wish to understand the scope and limitations of objective questions and to construct satisfactory test items for their own use. The first section discusses the nature of…

Presented are common words and phrases which are encountered in the statistical analysis of test results. Included are analysis of the mid-point, distribution of scores, calculation of scaled scores, test reliability, item analysis, and coefficients of reliability. (CS)

Investigated the validity of the assumption that arranging items in objective tests in order of increasing difficulty increases student motivation and produces more reliable tests. Results indicate that test reliability was largely independent of item sequence. (Author/JN)

Indicates that the language in which a multiple-choice question is couched may be a significant factor in student performance. Effects of changing key words, terms of quantity, negative to positive forms, and from passive to active voice are discussed. Also discusses the effect of rewording long or complex questions. (JN)

Presents data indicating that a large number of multiple-choice problems gives a reasonable correlation with hand-graded problems. (SK)

Presented is a description and copy of a test manual developed to include items in the test on the basis of children's performance; each item correlated highly with performance on an external criterion. The external criterion was the Individual Competency Measures of the elementary science program Science - A Process Approach (SAPA). The test…