Constructed response items can both measure the coherence of student ideas and serve as reflective experiences to strengthen instruction. We report on new automated scoring technologies that can reduce the cost and complexity of scoring constructed-response items. This study explored the accuracy of c-rater-ML, an automated scoring engine…

Online testing holds much promise for assessing students' complex science knowledge and inquiry skills. In the current study, we examined the comparative effectiveness of assessment tasks and test items presented in online modules that used either a static, active, or interactive modality. A total of 1,836 students from the classrooms of 22 middle…

Though addressing sources of uncertainty is an important part of doing science, it has largely been neglected in assessing students' scientific argumentation. In this study, we initially defined a scientific argumentation construct in four structural elements consisting of claim, justification, uncertainty qualifier, and uncertainty…

The purpose of this article is to address a major gap in the instructional sensitivity literature on how to develop instructionally sensitive assessments. We propose an approach to developing and evaluating instructionally sensitive assessments in science and test this approach with one elementary life-science module. The assessment we developed…

The Trends in International Mathematics and Science Study (TIMSS) is a comparative assessment of the achievement of students in many countries. In the present study, a rigorous independent evaluation was conducted of a representative sample of TIMSS science test items because item quality influences the validity of the scores used to inform…

Explores variables influencing the cognitive emphasis of teachers' examinations. Examination questions from Nigerian secondary school science teachers were analyzed according to Bloom's Taxonomy. The influence of the following variables on levels of questions was investigated: teachers' educational backgrounds, subjects taught, grade level taught,…

Investigates two evaluative hypotheses related to test item sequence and the performance of the students who take the tests. (SA)

The current status of "homemade" achievement tests reported in "Journal of Research in Science Teaching" and "Science Education" (January 1975 to January 1980) is examined using Anderson's (EJ 062 750) eight categories of information that a high quality research report should include. Findings from 142 references…

Croatian 1st-year and 3rd-year high-school students (N = 170) completed a conceptual physics test. Students were evaluated with regard to two physics topics: Newtonian dynamics and simple DC circuits. Students answered test items and also indicated their confidence in each answer. Rasch analysis facilitated the calculation of three linear…

Describes a paper-and-pencil test for high school biology students measuring science process skills, such as developing hypotheses; making predictions; identifying assumptions; analyzing data; and formulating conclusions. Reports some data on reliability and validity of the test. Provides all 35 items of the test. (YP)

Investigated the validity of the assumption that arranging items in objective tests in order of increasing difficulty increases student motivation and produces more reliable tests. Results indicate that test reliability was largely independent of item sequence. (Author/JN)

Determined which of 10 rational thinking powers are measured by 12 commercially-available standardized science tests. One result reported is that 90 percent of the test items required only recall. The conclusion was drawn that the producers of standardized tests are not concerned with measuring student achievement of the rational powers.…

Evaluates the attributes of a microcomputer software package as a supplement to chemistry instruction. Reports higher scores among the students in a control group. Discovers no significant interaction between treatment and development stage. Discusses several implications for further research. Provides the General Chemistry Test and error analysis…