Derived general formulas to determine the sample size requirements for hypothesis testing with desired power and interval estimation with desired precision. Illustrated the approach with the example of a screening test for adolescent attention deficit disorder. (SLD)

Provides a critical and comparative evaluation of the five most commonly used published rating scales for the assessment of ADHD. Reviews were conducted in four main areas: content and use, standardization sample and norms, scores and interpretation, and psychometric properties. Scales with the strongest standardization samples and evidence for…

The estimation accuracy of procedures based on classical test score theory and item response theory (generalized partial credit model) were compared for examinations consisting of multiple-choice and extended-response items. Analysis of British Columbia Scholarship Examination results found an error rate of about 10 percent for both methods, with…

Studied descriptive measurement reliability and validity of scores from the newly developed Mathematics Self-Efficacy Scale (MSES) for class and test with a sample of 302 Australian high school students. Results provide some evidence for the psychometric properties of the MSES in both contexts, but there is evidence of failure to counterbalance…

Discusses level 3 evaluation from Donald Kirkpatrick's Four Level Evaluation Model (level: 1-reaction; 2-learning; 3-behavior; 4-results) to measure training program performance. Highlights include an evaluation planning matrix; increasing evaluation data accuracy and reliability; data collection method selection; designing data collection…

The Career Decision-Making Self-Efficacy Scale-Short Form was completed by 416 South African and 563 Australian high school students. Analysis found three factors in each sample, but the factors differed between samples and from those of a U.S. sample, suggesting cultural differences in self-efficacy and lack of cultural equivalence for the…

Developed and tested an online survey to assess Web-based learning (WBL) educational programs, extending theoretical work on the Demand Driven Learning Model. Data from 93 adult learners from 3 WBL programs found high internal reliability and adequate construct validity for the 5 scales of the online measure. (SLD)

Developed a standardized self-report scale of environmental spatial ability, the Santa Barbara Sense of Direction Scale and evaluated it in six studies with 544 college students. Results supported the reliability of the scale and suggested that the scale is related to tasks that require one to update location in space as a result of self-motion.…

Notes that structural equation modeling (SEM) is a viable multivariate tool used by communication researchers for the past quarter century. Summarizes the use of this technique from 1995-2000 in 37 communication-based academic journals. Identifies and critically assesses 3 unique methods for testing structural relationships via SEM in terms of the…

Three studies with approximately 600 children were conducted to evaluate the validity and reliability of the three measures of the Communication and Symbolic Behavior Scales Developmental Profile. Findings support the use of the profile as a screening and evaluation tool for identifying children with developmental delays at 12 to 24 months of age.…

Using several data sets, the relative performance of the beta binomial model and two more general strong true score models in estimating several indices of classification consistency is examined. It appears that the beta binomial model can provide inadequate fits to raw score distributions compared to more general models. (TJH)

The article examines issues related to establishing a rationale for the use of early childhood rating scales and to selecting a rating scale using such criteria as user needs, user friendliness, scale format, score interpretation, reliability, and validity. Methods of establishing the validity of a rating scale are suggested. (Author/DB)

Influences on the educational validity of examinations are reviewed. Changes occurring in approaches to standard setting are traced. A view of reliability is presented, with emphasis on assessment of project work, which often involves individual investigation and design by students. A consistency index formula for grading standards is presented.…

Argues that the original Degrees of Reading Power (DRP) test scores indicated large mismatches between the average difficulty of the textbooks used in each grade and the average ability of students in that grade. Presents a rescaling procedure to provide new, valid DRP test scores and grade equivalent scores for selecting instructional materials.…

Developed and administered Reasoning about Abortion Questionnaire (RAQ) to measure how persons view abortions. Pilot tested the RAQ on 134 college students and modified scale on basis of data. Administered revised RAQ to college students (N=230) replicating factor pattern and obtaining evidence for validity of polarity scores through structured…