This paper presents a primer on building a scientifically oriented teacher evaluation instrument. It stresses the importance of accurate measures and accepts the presupposition that scientific approaches provide the most accurate measures of student teacher performance. The paper discusses the scientific concepts of validity and reliability, and…

Although by traditional measures of test validity, the verbal section of the Scholastic Aptitude Test (SAT) is not culture biased, it, along with the English Composition Test and the Test of Standard Written English, reinforces a narrow view of academic excellence that excludes culturally different youths. Designed to prevent admission errors, the…

This booklet is intended to help curriculum development personnel select an appropriate task list verification technique. The first sections of the guide introduce the concept of verification of task lists, provide a rationale for it, and define various terms connected with verification. The following four sections describe and make a case for…

Using a national sample of recent medical school graduates (n=12,213), a study of predictive validity of the National Board of Medical Examiners test parts I and II found strong correlations between performance on those parts and part III, supporting the test's use, at least in part, for selection of residency applicants. (MSE)

A study investigating possible sex bias, concerning both student and standardized-patient genders, in an objective structured clinical examination found that neither men nor women were afforded an advantage by patient or test location. However, women's scores on tests administered by females were higher than corresponding men's scores. (MSE)

A study was conducted to investigate issues of test validation by placing them in a context. The study examined the ways in which instances of "good" and "poor" writing have been identified in the marking of part of an English writing test that is given each year to incoming Arts Faculty students at the University of Hong Kong.…

A study investigated the performance of 6 successive medical school classes on 80 standardized-patient case examinations, looking for effects of student or standardized-patient gender on scores. Results showed no interaction of any practical consequence. Cases with gender-related concern (e.g., breast problems) also did not differentiate between…

A study assessed the feasibility of sequential testing of medical students using standardized patients. Sequential testing passes students who score well on the first segment of the test thus eliminating additional student-standardized patient encounters. Subjects were six classes of Southern Illinois University students (n=404). Results strongly…

To analyze the validity of W. L. Taylor's cloze testing methodology, this paper first examines three areas contributing to Taylor's thinking: communications theory, the psychology of speech and communication, and the theory of dispositional mechanisms--or nonessential words--in speech. It then evaluates Taylor's research to determine how he…

This paper provides an overview of standardized tests and a summary of important psychometric and test construction properties that educators must consider when they make critical evaluations of standardized tests. Sections of the paper concern: (1) basic characteristics of standardized tests; (2) differences between norm-referenced and…

One of the most widely used instruments for assessing concerns has been the Stages of Concern Questionnaire (SoCQ) developed by the Concerns Based Adoption Model Project. In this research, different aspects of the validity of a modified version of the SoCQ produced for use with preservice teachers (PSSoCQ) are examined. In all, 10 different…

Communicative competence is often characterized as an integrated control of language reflected in the speaker's ability to understand and use language appropriately for communication in various situations. The theoretical basis for the communicative competence construct is the anthropological, sociolinguistc, and pragmatic view of language.…

Organizational theorists have viewed organizations as "mini-societies" based upon commonly held cultural values and assumptions, which may serve to revolutionize organizational practices or to bring about new organization structures. The middle school is an example of an educational institution that has arisen as a result of a particular set of…

A study followed 66 medical students from matriculation through clerkship to determine the use of an anxiety measure, undergraduate grades, and Medical College Admission Test scores in predicting clerkship performance. Results showed disparities in prediction but suggest that the way students are evaluated in clerkships determined which factors…

A study investigated possible differences in standardized patient examination scores for three groups of undergraduate (n=176) and graduate (n=221) medical students assessed at different sites over two years. Results show no systematic change in scores over testing dates, suggesting no problems with breach of test security. (MSE)