Studies of the Angoff method of standard setting suggest that judges agree in their estimates of the relative difficulties of test questions for minimally competent examinees and that each judge's estimates correlate well with the observed item difficulties for examinees whose total test scores are near the judge's personal standard (G. E.…

This paper reports on the first stage of the construction and refinement process underway in pursuit of developing a brief composite instrument to measure teachers' attitudes toward computers. Items (n=284) from 14 questionnaires assessing teacher attitudes toward computers were completed by 118 educators in Texas in 1995. Internal consistency…

Speaking a second language is probably the most difficult skill to test in that it involves a combination of skills that may have no correlation with each other, and which do not lend themselves to objective testing. In addition, what can be understood is a function of the listener's background and ability as well as those of the speaker. Another…

The perspective of the examinee during the administration of a computerized adaptive test (CAT) is discussed, focusing on issues of test development. Item review is the first issue discussed. Virtually no CATs provide the opportunity for the examinee to go back and review, and possibly change, answers. There are arguments on either side of the…

People's beliefs about the origins of their health, sometimes referred to as health locus of control, have been shown to influence a variety of important behaviors, including the propensity to engage in effective health maintenance activities, and the willingness to seek and follow medical advice. The purpose of the present study was to explore…

This student guide for courses for health care assistants and nurse assistants contains 16 self-paced units with simplified line drawings, controlled text, vocabulary development, and mathematics practice exercises. Units consist of the following: objectives, introduction to the unit, content outline, steps of the procedure, skill sheets, written…

A job analysis was conducted of the knowledge and skills important for the competent performance of beginning business education teachers. The results of this job analysis will be used to define the content domain of the subject assessment in Business Education for the Praxis Series of professional assessments for beginning teachers. A domain of…

This handbook provides guidelines for instructors to follow in developing test items for occupational task lists. It begins with directions for task analysis: identifying major performance steps of a task, identifying supporting knowledge for each performance step, identifying supporting performance skills for each performance step, identifying…

The instructional validity of computer administered tests was studied with a focus on whether differences in test scores and item behavior are a function of instructional mode (computer versus non-computer). In the first of 3 studies, performance test scores for approximately 400 high school students in 1990-91 for tasks accomplished with the…

The psychometric properties of objective tests administered in two testing conditions were compared, using an experimental take-home testing condition and a traditional in-class testing condition. Subjects were 290 college students in a basic educational psychology course who took a test developed and tested the previous semester. Two equivalent…

In this article some results are presented relating to the dimensionality of instruments containing polytomously scored as well as dichotomously scored items, concentrating on the 1992 National Assessment of Educational Progress' (NAEP) mathematics and reading assessment data and several simulated datasets. The maximum likelihood factor analytic…

Context effects in test taking were explored, paying attention to the psychological processes that occur during test taking, and modeling context effects for each individual at the item block level. A sample of 279 high school students (140 females and 139 males) was chosen to yield adequate power for detecting interactions. Reading test forms…

Using data from a pilot test of science and math from students in 30 high schools, item difficulties were estimated with a one-parameter model (partial-credit model for the multi-point items). Some items were multiple-choice items, and others were constructed-response items (open-ended). Four sets of estimates were obtained: estimates for males…

This report examines the potential of adaptive testing, two-stage testing in particular, for improving the data quality of the National Assessment of Educational Progress (NAEP). Following a discussion of the rationale for adaptive testing in assessment and a review of previous studies of two-stage testing, this report describes a 1993 Ohio field…

This paper discusses the process through which a powerful multidimensional measure of affect and cognition in relation to adult learning of computing skills was derived from its early theoretical stages to its validation using structural equation modeling. The discussion emphasizes the importance of ensuring a strong substantive base from which to…