A method of estimating Rasch-model difficulty calibrations from judges' ratings of item difficulty is described. The ability of judges to estimate item difficulty was assessed by correlating estimated and empirical calibrations on each of four examinations offered by the American Association of State Social Work Boards. Thirteen members of the…

This paper presents six steps in test construction generally recommended by measurement textbook authors. The focus is primarily on paper-and-pencil achievement tests as used by class instructions, although the discussion touches on the construction of other types of assessment. The six steps are: (1) determine the test purpose; (2) determine the…

Fit statistics provide a direct measure of assessment accuracy by analyzing the fit of measurement models to an individual's (or group's) response pattern. Students that lose interest during the assessment, for example, will miss exercises that are within their abilities. Such students will respond correctly to some more difficult items and…

A method is presented for the simultaneous analysis of differential item functioning (DIF) in multi-factor situations. The method is unique in that it combines item response theory (IRT) and analysis of variance (ANOVA), takes a simultaneous approach to multifactor DIF analysis, and is capable of capturing interaction and controlling for possible…

The Hindi language proficiency guidelines are based on the 1986 generic ACTFL (American Council on the Teaching of Foreign Languages) proficiency guidelines. They represent a hierarchy of global characterizations of integrated performance in four skill areas (speaking, listening, reading, and writing) in Hindi. The guidelines for each skill area…

Six series of experiments (11 individual experiments involving over 150 subjects) were conducted to further extend automatic/controlled processing research to command and control mission-specific training. The issues examined in these experiments were related to retention of task-component skills of amount of practice, component training for…

This research investigated developmental shifts in the character of children's tool using activity in the domain of scale drawing. Fifty-five children from three grade levels (grades 3, 5, and 7) were individually interviewed as they participated in both enlarging and reducing a one-dimensional object, the letter "F," to a scale of four.…

A two-level regression model is imposed on the ability parameters in an item response theory (IRT) model. The advantage of using latent rather than observed scores as dependent variables of a multilevel model is that this offers the possibility of separating the influence of item difficulty and ability level and modeling response variation and…

This study investigated the effect of writing task topic on learner performance in a second-language writing test, in this case the Michigan English Language Assessment Battery designed to test proficiency in English as a Second Language. The 64 topics or "prompts" used in the test (offered as pairs of options) were categorized according…

The notion of literature's difficulty must have begun with its first interpreter. Biblical readings sometimes allegorized scripture into moral precept, while occult readings (i.e., Gnostic writings) often carried an implication that such texts are either for an elite readership or represent the essence of a tradition of spiritual truth under…

Groups of individuals classified as "constricted" and "non constricted" according to three personality scores - anger expression, independence, and anomie - were contrasted on civil liberties attitude dimensions. It was found that "constricted" individuals do not have a simpler conceptual structure for those attitudes…

The difficulty of understanding embedded sentences is discussed in relation to Bever's hypothesis: if a sentence segment has a double function by means of the same processing strategy it is difficult to interpret the sentence. An alternative to this theory is proposed due to the author's experiments. (SCC)

Presents two experiments which investigated whether there is a shift with age in the relative speed and difficulty of same versus different judgments. Subjects included preschoolers, third graders, and college students. (SDH)