The psychometric characteristics of the Test of Written English (TWE) rating scale were explored. Rasch model scalar analysis methodology was employed with more than 4,000 scored essays across 2 elicitation prompts to gather information about the rating scale and rating process. Results suggested that the intervals between TWE scale steps were…

The purpose of this study was to profile the preferred productivity and learning style preferences of participants enrolled in distance education courses at Marshall University (West Virginia) (Spring of 1995). The accessible population of this study consisted of 167 distance education participants in nursing, education, and paralegal programs. A…

A desirable goal would be to develop a methodology for scoring essays so that the final grades are less affected by when or by whom each essay was read. It seems sensible to derive such grades by somehow adjusting the ratings originally given by each reader. This essay describes a solution that relies on statistical adjustment, using the context…

The work of R. MacCallum et al. (1992) was extended by examining chance modifications through a Monte Carlo simulation. The stability of post hoc model modifications was examined under varying sample size, model complexity, and severity of misspecification using 2- and 4-factor oblique confirmatory factor analysis (CFA) models with four and eight…

Statistical significance is often misinterpreted to mean replicability or generalizability of results, although a statistically significant difference does not equal a reliable difference. Sample splitting procedures may be a more accurate way of estimating research result generalizability. This type of cross-validation involves randomly dividing…

A study investigated the impact of "thought over time" as a variable that may influence recall of discrepant information encountered in the media. Earlier studies indicated that human subjects are capable of improving their recall of "consistent" sets of news information over time without the benefit of additional exposure to…

The analysis of covariance as a procedure for statistical correction of the effects for an extraneous variable, called a "covariate," is presented. An heuristic data set is used to make the discussion of the calculation of ANCOVA partitions easier to follow. A discussion of homogeneity of regression as an essential condition to be met…

This study investigates the Test of English as a Foreign Language (TOEFL), in particular the relative contributions to score dependability (analogous to classical theory reliability) of various numbers of items and subtests as well as the decision dependability at different cut points. Research questions that apply to the overall TOEFL battery and…

An analysis of variance approach to estimating reliability is examined. This approach uses an internal-consistency index for estimating the reliability of survey instruments containing ranked items, and is recommended when the relative ranking of item means is of interest to survey researchers. The computation of this index is demonstrated using…

The relevance of ethnographic research to evaluation of educational programs is discussed. The author focuses on evaluation questions that deal with finding out what is happening in a program and if what is happening is desirable. Ethnography suits the purposes of evaluators who answer such questions because they want to know how something works…

A sample of prominent psychotherapists were asked to fill out the A-B therapist "type" scale and comment on their possible differential effectiveness in treating schizoid/schizophrenic versus neurotic patients. The data suggest that B therapists desire and seek more complex and exciting sensory-cognitive inputs during therapy hours than A…

The multi-trait-multimethod procedure was used to assess the validity of Spillberger's dual conception of anxiety and the interpretation of his scales in a graduate level, educational environment. (Author/KM)

Findings indicate that students are capable of matching the relative changes in the level of experiences test anxiety with changes in the amplitude of auditory stimulus. (Author/KM)

Various item selection techniques are compared on criterion-referenced reliability and validity. Techniques compared include three nominal criterion-referenced methods, a traditional point biserial selection, teacher selection, and random selection. (Author)