This article discusses practical and theoretical problems related to the measurement of formal operations. The first section of the article discusses problems in measuring formal operations using the clinical interview method. These problems include the lack of both a standardized interview and a uniform scoring procedure. Section two discusses…

Seventeen educational measurement textbooks were reviewed to analyze current perceptions regarding true-false achievement testing. A synthesis of the rules for item writing is presented, and the purported advantages and disadvantages of the true-false format derived from those texts are reviewed. (TJH)

Investigates the reliability and validity of scores yielded from a new scoring formula. (Author/DEP)

True-false achievement test items written by typical classroom teachers show about two-thirds of the discrimination of their multiple-choice test items. This is about what should be expected in view of the higher probability of chance success on the true-false items. However, at least half again as many true-false items as multiple-choice items…

Empirically weighted scores for Rest's Defining Issues Test were found to be more reliable than the simple sum of scores theoretically weighted sum, or Rest's p scores. They also had slightly higher correlations with Kohlberg's interview scores. Empirically weighted scores also showed more significant change in two longitudinal studies. (CTM)

Intercorrelations among multiple true-false items were examined to determine to what extent each choice can be treated as independent. Results from 157 health science and 170 medical students indicated that correlations between options from the same stem were larger than those from different stems. Methods for computing reliability estimates were…

Examiners seeking guidance on multiple-choice and true/false tests are likely to encounter various faulty or questionable ideas. Twelve of these are discussed in detail, having to do mainly with the effects on test reliability of test length, guessing and scoring method (i.e. number-right scoring or negative marking). Some misunderstandings could…

An area of current concern is that of the advantages and disadvantages of measuring writing proficiency directly via writing samples, and indirectly via objective tests. Much research has been completed documenting the correlation between direct and indirect measures. However, there had not yet been a systematic and detailed conceptual analysis…

Probabilistic testing involves having the examinee assign probabilities to each of the options of a multiple-choice item. These probabilities reflect the student's perception of the correctness of each option. What is presented in the paper is a rationale for probability testing, the current theoretical and empirical findings, and some suggested…

Describes an objective test used as the comprehensive examination in a graduate library school and discusses its advantages over essay tests. The topics covered include test construction, the use of item analysis for scoring and test revision, and student reactions to the objective test. (1 reference) (CLB)

Coded, as opposed to free response items, in a multiple choice physiology test had a cueing effect which raised students' scores, especially for lower achievers. Reliability of coded items was also lower. Item format and scoring method had an effect on test results. (GDC)

Four threats to validity of an alternative objective test item format, the multiple-mark format, were studied with data from a state-mandated assessment with about 30,000 students at each of three grade levels. Reliability and validity coefficients show that the format has promise as an objective format that can be aligned with new curriculum…

The relationship among writing assessment strategies which may be applicable to competency based testing was examined in a study involving 128 high school students in six English classes in grades 11 and 12. Each student wrote two essays of at least 200 words on topics designed to test expository, or explanatory writing, and completed an objective…

The third administration of the California State University and Colleges Freshman English Equivalency Examination, a test consisting of an objective examination graded by the Educational Testing Service and an essay examination scored by California State University and College faculty, is analyzed in this report. After a short preface, the first…

The fourth administration of the California State University and Colleges Freshman English Equivalency Examination, a test consisting of an objective examination graded by the Educational Testing Service and an essay examination scored by California State University and College faculty, is analyzed in this report. After a short index of previous…