Studied descriptive measurement reliability and validity of scores from the newly developed Mathematics Self-Efficacy Scale (MSES) for class and test with a sample of 302 Australian high school students. Results provide some evidence for the psychometric properties of the MSES in both contexts, but there is evidence of failure to counterbalance…

Discusses level 3 evaluation from Donald Kirkpatrick's Four Level Evaluation Model (level: 1-reaction; 2-learning; 3-behavior; 4-results) to measure training program performance. Highlights include an evaluation planning matrix; increasing evaluation data accuracy and reliability; data collection method selection; designing data collection…

The Career Decision-Making Self-Efficacy Scale-Short Form was completed by 416 South African and 563 Australian high school students. Analysis found three factors in each sample, but the factors differed between samples and from those of a U.S. sample, suggesting cultural differences in self-efficacy and lack of cultural equivalence for the…

Developed and tested an online survey to assess Web-based learning (WBL) educational programs, extending theoretical work on the Demand Driven Learning Model. Data from 93 adult learners from 3 WBL programs found high internal reliability and adequate construct validity for the 5 scales of the online measure. (SLD)

Developed a standardized self-report scale of environmental spatial ability, the Santa Barbara Sense of Direction Scale and evaluated it in six studies with 544 college students. Results supported the reliability of the scale and suggested that the scale is related to tasks that require one to update location in space as a result of self-motion.…

Notes that structural equation modeling (SEM) is a viable multivariate tool used by communication researchers for the past quarter century. Summarizes the use of this technique from 1995-2000 in 37 communication-based academic journals. Identifies and critically assesses 3 unique methods for testing structural relationships via SEM in terms of the…

Using several data sets, the relative performance of the beta binomial model and two more general strong true score models in estimating several indices of classification consistency is examined. It appears that the beta binomial model can provide inadequate fits to raw score distributions compared to more general models. (TJH)

Describes development of computer-based case simulation designed to assess skill in predicting client behavior and conceptual ability, resolution of informational dissonance, and experiential learning. Reviews theoretical basis for simulation. Summarizes preliminary investigation of simulation's reliability and validity. Discusses future research.…

Discussion of computer-assisted psychological evaluation focuses on its use as legal evidence. Topics discussed include legal criteria for expertise; clinical psychology and standards for expertise; factors relating to reliability and validity, including the proper use of data; computerized test administration; computer-based test interpretation;…

Discussion of software evaluation for computer assisted instruction focuses on the Computer Courseware Evaluation Model (CCEM), developed at the University of South Florida. Criteria for reliability and validity are discussed, and areas of concern in software are addressed, including cost and presentation characteristics, instructional…

This empirical study of undergraduates compared the psychometric properties, i.e., reliability and validity, of four computer attitude measures and their subscales. Results are analyzed that indicate all measures tested were essentially equal in terms of reliability and validity, and attempts to empirically derive improved scales were…

Empirical reliabilities of scores based on item-pattern scoring, using 3-parameter item-response theory and number-correct scoring, were compared within each of 5 score metrics for at least 900 elementary school students for 5 content areas. Average increases in reliability were produced by item-pattern scoring. (SLD)

The distinction between two models of reliability is clarified. Reliability may be conceived of and estimated from a true score model or from the perspective of sampling precision. Basic models are developed and illustrated for each approach using data from the author's work on measuring organizational climate. (SLD)

Reliability and validity of the Risk Behavior Assessment, a questionnaire evaluating drug use and sexual human immunovirus risk behavior through self-reports, were studied with 218 drug users who also provided urine samples. Overall, self-reports of drug use and sexual behavior were reliable. (SLD)

Discusses the use of alternative assessment procedures in English-as-a-Second-Language classrooms, focusing on three issues: (1) definitions of alternative assessment; (2) issues related to validity, reliability, and objectivity that are often raised as objections to alternative assessment; and (3) the power of alternative assessment to provide…