Discusses level 3 evaluation from Donald Kirkpatrick's Four Level Evaluation Model (level: 1-reaction; 2-learning; 3-behavior; 4-results) to measure training program performance. Highlights include an evaluation planning matrix; increasing evaluation data accuracy and reliability; data collection method selection; designing data collection…

The Career Decision-Making Self-Efficacy Scale-Short Form was completed by 416 South African and 563 Australian high school students. Analysis found three factors in each sample, but the factors differed between samples and from those of a U.S. sample, suggesting cultural differences in self-efficacy and lack of cultural equivalence for the…

Developed and tested an online survey to assess Web-based learning (WBL) educational programs, extending theoretical work on the Demand Driven Learning Model. Data from 93 adult learners from 3 WBL programs found high internal reliability and adequate construct validity for the 5 scales of the online measure. (SLD)

Developed a standardized self-report scale of environmental spatial ability, the Santa Barbara Sense of Direction Scale and evaluated it in six studies with 544 college students. Results supported the reliability of the scale and suggested that the scale is related to tasks that require one to update location in space as a result of self-motion.…

Notes that structural equation modeling (SEM) is a viable multivariate tool used by communication researchers for the past quarter century. Summarizes the use of this technique from 1995-2000 in 37 communication-based academic journals. Identifies and critically assesses 3 unique methods for testing structural relationships via SEM in terms of the…

Three studies with approximately 600 children were conducted to evaluate the validity and reliability of the three measures of the Communication and Symbolic Behavior Scales Developmental Profile. Findings support the use of the profile as a screening and evaluation tool for identifying children with developmental delays at 12 to 24 months of age.…

Using several data sets, the relative performance of the beta binomial model and two more general strong true score models in estimating several indices of classification consistency is examined. It appears that the beta binomial model can provide inadequate fits to raw score distributions compared to more general models. (TJH)

The article examines issues related to establishing a rationale for the use of early childhood rating scales and to selecting a rating scale using such criteria as user needs, user friendliness, scale format, score interpretation, reliability, and validity. Methods of establishing the validity of a rating scale are suggested. (Author/DB)

Influences on the educational validity of examinations are reviewed. Changes occurring in approaches to standard setting are traced. A view of reliability is presented, with emphasis on assessment of project work, which often involves individual investigation and design by students. A consistency index formula for grading standards is presented.…

Argues that the original Degrees of Reading Power (DRP) test scores indicated large mismatches between the average difficulty of the textbooks used in each grade and the average ability of students in that grade. Presents a rescaling procedure to provide new, valid DRP test scores and grade equivalent scores for selecting instructional materials.…

Developed and administered Reasoning about Abortion Questionnaire (RAQ) to measure how persons view abortions. Pilot tested the RAQ on 134 college students and modified scale on basis of data. Administered revised RAQ to college students (N=230) replicating factor pattern and obtaining evidence for validity of polarity scores through structured…

Describes development of computer-based case simulation designed to assess skill in predicting client behavior and conceptual ability, resolution of informational dissonance, and experiential learning. Reviews theoretical basis for simulation. Summarizes preliminary investigation of simulation's reliability and validity. Discusses future research.…

Reviews recent developments in the use of commercially available written integrity tests for employee selection. Discusses legal issues related to the use of the polygraph and integrity tests, and reviews empirical research on the reliability, criterion-related validity, construct validity, fakeability, and adverse effects of integrity tests. (TE)

A study in four first-year dental school classes found that while the Myers-Briggs Type Indicator is a good measure of dental students' personality traits, it is not a useful measure for predicting first-year achievement. (MSE)

Examines whether using a combined silent reading-listening mode to administer the "Social Studies Inference Test" optimized information gathering. Finds that the combined modality produced more correct inferences than did silent reading alone. Finds only one gender difference--girls'"caution score" was higher than that for…