The degree of invariance of the Job Responsibilities Scale for medical technologists was studied for 1993 and 1995, conducting factor analyses of data from each year (1063 and 665 individuals, respectively). Nearly identical factor patterns were found, and Rasch rating scale analyses found nearly identical pairs of item estimates. Implications are…

This module prepares the reader to use statistical procedures to detect differentially functioning test items. The Mantel-Haenszel statistic, logistic regression, the SIBTEST procedure, the Standardization procedure, and various item response theory-based procedures are presented. Theoretical frameworks, strengths and weaknesses, and…

An analysis of data from the 1990 National Assessment of Educational Progress Trial State Assessment suggests that person-fit statistics may not provide additional information about results of psychometrically strong achievement tests. More research is needed before person-fit statistics can be used routinely in analysis of item response data.…

The Career Maturity Inventory was revised in 1995 using previously unpublished longitudinal data for item selection. The new inventory has 25 attitude and 25 competence items, each yielding a score that measures degree of career maturity of conative and cognitive variables, respectively. (SK)

An automated item selection procedure for selecting unidimensional scales of polytomous items from multidimensional data sets is developed for use in the context of the item response theory model of monotone homogeneity of R. J. Mokken. The procedure is based on the selection procedure proposed by Mokken (1971). (SLD)

Sources of observed differences in difficulty between items in graph comprehension performance were studied using 132 items from the Psychometric Entrance Test, an Israeli college entrance examination. Results indicate that item difficulty can be predicted successfully on the basis of item characteristics and task demands. Implications for graph…

Investigated the functioning of a new computer-delivered graphical modeling (GM) response type for use in a graduate admissions assessment using two GM tests differing in item features randomly spiraled among participants. Results show GM scores to be reliable and moderately related to the quantitative section of the Graduate Record Examinations.…

Reviews examination questions and categorizes them according to their usefulness in a Computer Algebra System (CAS) environment with respect to their significance for testing abilities and skills and from the point of view of using a CAS for their solution. Examination questions are presented as an important didactical tool in teaching…

Attempted to relate content features of personality items to item parameter estimates from the partial credit model of E. Muraki (1990) by administering the Adjective Checklist (L. Goldberg, 1992) to 329 undergraduates. As predicted, the discrimination parameter was related to the item subtlety ratings of personality items but the level of word…

Discusses the comparison of groups of individuals who were administered different forms of a test. Focuses on the situation in which there is little overlap in content between the test forms. Reviews equating problems in national tests in Canada and Israel. (SLD)

Analysis of literature on oral assessment in college instruction identified six dimensions: primary content type; interaction between examiner and learner; authenticity of assessment task; structure of assessment task; examiner; and orality (extent to which knowledge is tested orally). These help in understanding the nature of oral assessment and…

Used two different coherent cut kinetics taxonomic procedures to examine the latent structure of responses to a survey of library service quality using an unnumbered slider-bar user interface and a radio-button user interface. Results for 354 college students show that both interfaces yield similar latent structures of survey item responses. (SLD)

Describes the performance of eighth graders on 37 questions from the National Assessment of Educational Progress 1998 Civics Assessment and indicates percentages of students answering given questions correctly. Includes samples of students' written responses. (Author/SLD)

In educational settings, achievement is one of the most significant factors for assessing the effectiveness of the educational institution, being the criterion used to evaluate the performance of individuals and institutions. The score obtained from an achievement test provides primarily two types of information: one is the degree to which the…

Complete response vectors of all answer options in multiple-choice items can be used to estimate ability. The rising selection ratios criterion is necessary for scoring individuals because it implies that estimated ability always increases when the correct alternative is selected. This paper introduces the generalized DLT model, which assumes…