The difficulty of test items administered by paper and pencil were compared with the difficulty of the same items administered by computer. The study was conducted to determine if an interaction exists between mode of test administration and ability. An arithmetic reasoning test was constructed for this study. All examinees had taken the Armed…

An investigation of the effect on the difficulty value of an item due to position placement within a test was made. Using a 60-item operational test comprised of 5 subtests, 60 items were placed as experimental items on a number of spiralled test forms in three different positions (first, middle, last) within the subtest composed of like items.…

Describes a project at Chorleywood College (England) which examined the possibility of automating the transcription of braille examination responses for marking by examination boards. Discussion covers the braille code, requirements of the transcription system, an analysis of mock examination papers which led to system modification, and the final…

This report, based on a survey completed by testing directors in states that are members of the Southern Regional Education Board (SREB), describes the status of online testing in SREB states. Overall, SREB states are paying limited attention to online testing. Only Virginia is moving systematically to implement online testing. By spring 2004, all…

Examined, through analysis of questions about conflict between separated parents (N=327), three hypotheses about the relationship among frequency and intensity response questions. Found associations among related intensity items possibly stronger than those among related frequency items; associated intensity items and associated frequency items…

Research on true-false (TF), multiple-choice, and alternate-choice (AC) tests is reviewed, discussing strengths, weaknesses, and the usefulness in classroom and large-scale testing of each. Recommendations are made for improving use of AC items to overcome some of the problems associated with TF items. (SLD)

As adaptive testing moves toward operational implementation in large scale testing programs, where it is important that adaptive tests be as parallel as possible to existing linear tests, a number of practical issues arise. This paper concerns three such issues. First, optimum item pool size is difficult to determine in advance of pool…

Upon learning that a form of the Sequential Tests of Educational Progress was incorrectly distributed to an unidentified number of high school students along with an answer sheet pregridded with an alternate test form, the Austin Independent School District performed the following research analyses: (1) scored the tests using the key for each…

Over the years many criticisms have been offered against the multiple choice test format. Ambiguous, and emphasizing isolated information, they are also the most difficult objective tests to construct. Over-interpretation is a danger of multiple choice examinations with students picking subtle answers the test makers consider incorrect. Yet, the…

In many African countries tests used as a selection examination for entrance to secondary and higher levels of education do not have content validity. The practices and problems of test development in Africa are discussed. The advantages of domain-referenced tests are examined. (RM)

Discusses how listening is now being tested as three separate abilities, how test validity is affected by administration factors, criticisms of listening skills tests currently available, and criteria for development of reliable and valid listening tests. (MBR)

Considers issues surrounding the use of differentiated examinations. Discusses how differentiation may be provided, the wording of questions, and how marks should be given. Highlights some pitfalls of using this approach. Concludes that, although differentiated examinations are possible, they will not always meet the needs of the end range of test…

The comparability of scores on test forms that are constructed through examinee item choice is examined in an item response theory framework. The approach is illustrated with data from the College Board's Advanced Placement Test in Chemistry taken by over 18,000 examinees. (SLD)

Reexamined Counselor Evaluation Rating Scale (CERS) using confirmatory factor analysis. Analyzed 185 self-rated CERs. Findings suggest that, when counselors use CERS to rate themselves, different factors may emerge from those emerging when experienced supervisors use CERS to evaluate supervisee progress and performance. (Author/NB)

Some cautions are sounded for converting a linearly administered test to an adaptive format. Four areas are identified in which practices broadly used in traditionally constructed tests can have adverse effects if thoughtlessly adopted when a test is administered in an adaptive mode. (SLD)