Prior research in a single clinical training setting has shown Cason and Cason's (1981) simplified model of their performance rating theory can improve rating reliability and validity through statistical control of rater stringency error. Here, the model was applied to clinical performance ratings of 14 cohorts (about 250 students and 200 raters)…

The proposed standard for judging proficiency test score reliability requires that the proportion of items passed for each objective assessed be a dependable estimate of the universe score for the domain strata established by the objective. Domain breadth is the focusing issue. Data from a field trial of the Tennessee Proficiency Test are analyzed…

This manual is designed to assist faculty members at the University of North Dakota (UND) in the construction, scoring, and analysis of their classroom tests. A computer program is described which will assist staff in test scoring and analysis. The program was developed by the author in the Office of Medical Education and Evaluation of the…

To explain discrepancies in Utah's elementary school test results under the Elementary and Secondary Education Act's Title I Evaluation and Reporting System (TIERS), researchers investigated the adequacy and validity of TIERS evaluation models. Model A (norm-referenced testing) is used in most Utah school districts, in preference to Models B or C…

This paper presents a new method for estimating a given latent trait variable by the least-squares approach. The beta weights are obtained recursively with the help of Fourier series and expressed as functions of item parameters of response curves. The values of the latent trait variable estimated by this method and by maximum likelihood method…

Data are summarized in Scheuneman's Score x Group x Response frequency table in order to investigate item bias. The data can arise from two different sampling models: (1) multinomial sampling in which a fixed sample size is used and the responses are cross-classified according to score, group, and response; and (2) product-multinomial sampling in…

A summary is provided of the rationale for questioning the applicability of classical reliability measures to criterion referenced tests; an extension of the classical theory of true and error scores to incorporate a theory of dichotomous decisions; a presentation of the mean split-half coefficient of agreement, a single-administration test index…

A visual analogue mood scale was developed that included an option indicating subjects didn't understand the meaning of an adjective in an item. The item content significantly affected responses, raising questions about the adequacy of recently proposed affective taxonomies that were based on restricted samples of emotion-descriptive adjectives.…

Presents major stages in design and development of criterion referenced tests (CRT) with emphasis on differences between CRT construction and norm-referenced test construction. Discussion covers test interpretation; test theory; preparation for test construction (hierarchical analysis, item type selection, and choosing number of items); test…

Describes a study designed to determine if the amount of time allocated for answering multiple true/false type questions affects the grades of the medical students taking the tests. Students who had 2-1/4 minutes to answer each question scored significantly better than those who had 1-1/2 minutes or 3 minutes. (TW)

Analyzes an old chemistry examination that was given to a college chemistry class in 1984. Contrasts several of the examination's features against most modern ones. Notes the emphasis on observable properties and the practical applications of substances. Argues that the newer examinations may stress too much theory and don't stress communication…

Fifty education majors in two sections responded to an Attitudes toward Mathematics and Its Teaching (ATMAT) scale. Results with two psychometric models, classical true-score theory and the one-parameter Rasch model, supported the ATMAT's reliability, content and construct validity, and invariance over three time points. (SLD)

Criterion-referenced testing was used to complement norm-referenced procedures in a revision of a university's English-as-a-Second-Language placement test for reading. Test validation results indicated that the revised test better matched the university's program and included more items related to the content and skills that students were…

Describes two Quebec studies integrating educational diagnosis with classroom assessment to develop learning strategies. Outlines new model based on studies and new mastery learning developments. Argues that the unit of measurement should shift from the student to the teacher-student interaction, and the methodology should be…

Describes five propositions concerning classroom assessment. Uses propositions to review seven conference papers. Propositions refer to the following: nature of achievement; student information necessary to interpret assessments; tension between need to describe and need to praise; distinction between formal and informal assessment; and need for…