In a classroom, a teacher attempts to convey his or her knowledge to the students, and thus it is important for the teacher to obtain formative feedback about how well students are understanding the new material. By gaining insight into the students' understanding and possible misconceptions, the teacher will be able to adjust the teaching and to…

The purpose of this study was to explore how Year 8 students answered Third International Mathematics and Science Study (TIMSS) questions and whether the test questions represented the scientific understanding of these students. One hundred and seventy-seven students were tested using written test questions taken from the science test used in the…

OBJECTIVE: To report the assessment of psychopharmacology on the certification and recertification exams in general psychiatry and in the subspecialties administered by the American Board of Psychiatry and Neurology (ABPN). METHODS: The ABPN's core competencies for psychiatrists were reviewed. The number of items addressing psychopharmacology or…

Described in this paper are the first three activities of a research program designed to assess the differential validity and utility of successive and simultaneous approaches to the development of equivalent achievement tests in the French and English languages. Two teams of multilingual/multicultural French-English teachers used the simultaneous…

This article describes the translation goals, challenges, strategies, and solutions employed in the development of a computer-based, self administered, psychiatric diagnostic instrument, the Diagnostic Interview Schedule for the Deaf (D-DIS-IV) in American Sign Language (ASL) with English captions. The article analyzes the impact of the…

This policy research document is intended for Arkansas policymakers to use when examining possible changes to the Arkansas state assessment's alignment with the National Assessment of Educational Progress (NAEP). The 2009 NAEP test is not yet in existence, so the purpose of this report is to give policymakers a head start in determining where they…

What types of instructional experiences help K-8 students learn science with understanding? What do science educators, teachers, teacher leaders, science specialists, professional development staff, curriculum designers, and school administrators need to know to create and support such experiences? "Ready, Set, Science!" guides the way with an…

Results from the Ontario Secondary School Literacy Test (OSSLT) indicate that English as a Second Language (ESL) and English Literacy Development (ELD) students have comparatively low success and high deferral rates. This study examined the 2002 and 2003 OSSLT test performances of ESL/ELD and non-ESL/ELD students in order to identify and…

This study developed, applied, and evaluated a theory-based method of detecting the underlying causes of differential difficulty. The method was applied to two subgroups taking the Scholastic Aptitude Test-Mathematics (SAT-M), 261 visually impaired students taking Braille forms of the test and 1,985 black students at 3 test administrations. It…

Two frequently cited guidelines for writing multiple choice test item stems are: (1) the stem can be written in either a question or statement-to-be-completed format; and (2) only positively worded stems should be used. These guidelines were evaluated in a survey of the test item banks of 13 nationally administered examinations in the physician…

The issue of what exactly is measured by different types of reading items has been a matter of interest in the field of reading research for many years. Language teaching and testing specialists have raised the question of whether a reading test for foreign students wishing to enter a university in the United States should include questions…

In the context of the development of a possible national mathematics assessment, a study was conducted to determine whether a test item characterization scheme could be created based on a state policy document that serves as the driving force behind large-scale performance assessment. Further considerations were whether such an item…

This study investigated the convergent validity of expert-system scores for four mathematical constructed-response item formats. A five-factor model was proposed comprised of four constructed-response format factors and a Graduate Record Examinations (GRE) General Test quantitative factor. Subjects were drawn from examinees taking a single form of…

It was hypothesized that, when compared to the Angoff method (W. H. Angoff, 1971), the Nedelsky method (L. Nedelsky, 1954) for standard setting had lower intrajudge inconsistency, lower cutscores, and lower cutscores especially for items presenting challenges to the judges. These hypotheses were tested and supported in a sample of 22 graduate…

Educational measurement is undergoing a revolution due to the rapid dissemination of information-processing technology. The recent growth in computing resources and their widespread dissemination in daily life have brought about irreversible changes in educational measurement. Recent developments in computerized measurement are summarized by…