Even though the impact of the position of response options on answers to multiple-choice items has been investigated for decades, it remains debated. Research on this topic is inconclusive, perhaps because too few studies have obtained experimental data from large-sized samples in a real-world context and have manipulated the position of both…

We study the automatic identification of educational items worthy of content authors' attention. Based on the results of such analysis, content authors can revise and improve the content of learning environments. We provide an overview of item properties relevant to this task, including difficulty and complexity measures, item discrimination, and…

Effective listening comprehension skills are an important prerequisite for the academic success of primary school students. However, the assessment of listening skills in the instructional language appears to have received only scant attention in the literature. Therefore, the goal of the present study was twofold. Firstly, a comprehensive…

The purpose of this study was to examine the overall level of student achievement on the 2012 Kansas History-Government Assessment in Grades 6, 8, and high school, with major emphasis on the subject area of economics. It explored four specific research questions in order to: (1) determine the level of student knowledge of assessed economic…

The population sensitivity of vertical scaling results was evaluated for a state reading assessment spanning grades 3-10 and a state mathematics test spanning grades 3-8. Subpopulations considered included males and females. The 3-parameter logistic model was used to calibrate math and reading items and a common item design was used to construct…

Development of adaptive tests used in K-12 settings requires the creation of stable measurement scales to measure the growth of individual students from one grade to the next, and to measure change in groups from one year to the next. Accountability systems like No Child Left Behind require stable measurement scales so that accountability has…

For educational achievement tests that employ multiple-choice (MC) items and aim to reliably classify students into performance categories, it is critical to design MC items that are capable of discriminating student performance according to the stated achievement levels. This is accomplished, in part, by clearly understanding how item design…

In this technical report, we describe the development and piloting of a series of mathematics progress monitoring measures intended for use with students in grade 1. These measures, available as part of easyCBM [TM], an online progress monitoring assessment system, were developed in 2008 and administered to approximately 2800 students from schools…

A sample of slightly over 1,500 students from even-numbered grades in public schools of the U.S. Virgin Islands were given the 1973 edition of the Stanford Achievement Test (in grades 2, 4, 6, and 8) and the Test of Academic Skills (grades 10 and 12) in an attempt to assess student academic achievement in the basic skill areas of mathematics,…

The "A" testing program of the Beginning Teacher Evaluation Study, Phase III-B, is summarized. A sample of 150 second grade and 134 fifth grade students completed the reading and mathematics achievement battery, as well as affective scales regarding reading, mathematics, and school. The administration procedures, test results, and psychometric…

The "B" testing program of the Beginning Teacher Evaluation Study, Phase III-B, is summarized. A sample of 146 second grade and 128 fifth grade students completed the reading and mathematics achievement battery, as well as affective scales pertaining to reading, mathematics, and school. The administration procedures, test results, and psychometric…

The "C" testing program, which followed the "A" and "B" tests of the Beginning Teacher Evaluation Study, is summarized. A sample of 139 second grade and 123 fifth grade students completed the reading and mathematics achievement battery, as well as affective scales regarding reading, mathematics, and school. The administration procedures, test…

This paper describes teacher usage of the microcomputer programs Test Analysis Package (TAP) and Student Problem Package (SPP) to analyze students' test item responses. These methods of organizing, analyzing, and reporting test results have proven useful to classroom teachers. The TAP consists of four integrated microcomputer programs to edit,…