Single construct validity is examined, and appropriate statistical tests are described when criterion information is available for: (1) examinees selected at random; (2) examinees selected on the basis of the current test; and (3) examinees selected using other measures of the latent construct. Discriminant validity is also discussed. (SLD)

This paper identifies methodological and practical problems in studies of child maltreatment, including developing classification schemes for multiple forms of maltreatment; distinguishing between chronic maltreatment and isolated incidents; choosing criteria for selecting comparison groups; determining whether comparison groups have experienced…

The methods of 27 studies focusing on toy play among young children with mental retardation were reviewed. Considerable variability was noted with respect to sample characteristics, contextual parameters, and type of measurement. Researchers frequently neglected to provide potentially useful methodological information. Suggestions for future…

This article presents a synopsis of each of seven presentations given at a conference on design and analysis in community trial studies. Papers identify problems with community trials and discuss strengths and weaknesses associated with design and analysis strategies. Areas of consensus are summarized. (SLD)

An original study with a 96 percent questionnaire return rate and four replications with high return rates were compared in terms of populations sampled, implementation, and results. Future use of this procedure, which includes advance mailing, telephone contact, telephone explanations, and followups, is discussed. (SLD)

Presents solutions for the problem of maximizing the generalizability coefficient under a budget constraint. Shows that the Cauchy-Schwarz inequality can be applied to derive optimal continuous solutions for the number of conditions of each facet. Illustrates the formal similarity between optimization problems in survey sampling and…

This paper compares the results of National Center for Education Statistics (NCES) and the Carnegie surveys of postsecondary faculty and notes the differently constructed samples, the different response rates, and different weighting schemes in analysis and interpretation. Inconsistencies in the surveys' results are identified and methodological…

This paper argues that judgment-based assessment of data from multiply replicated single-subject or small-N studies should replace normative-based (p=less than 0.05) assessment of large-N research in the clinical sciences, and asserts that inferential statistics should be abandoned as a method of evaluating clinical research data. (Author/JDD)

Provides data defensibility guidance for field samplers, laboratory personnel and project managers, and a checklist for planning and verification stages of the data generation process. (MDH)

Nine comprehensive observations were conducted of 24 preschoolers (8 with disabilities) in free play settings, with social behavior categories based on the work of Strain. Comparison of partial and complete observational records demonstrated that at least five observations were required to represent the children's social behavior adequately.…

Discussion of user queries in information retrieval highlights the experimental evaluation of an adaptive linear model that constructs improved query vectors from user preference judgments on a sample set of documents. The performance of this method is compared with that of standard relevance feedback techniques. (28 references) (LRW)

A framework and concepts for developing inclusion criteria for meta-analysis are presented and illustrated in a meta-analysis of primary studies in patient education for preventive health services. Of 5,451 citations located and abstracts screened, 64 studies eventually met acceptability criteria. (SLD)

Use of parallel analysis (PA), a selection rule for the number-of-factors problem, is investigated from the viewpoint of permutation assessment through a Monte Carlo simulation. Results reveal advantages and limitations of PA. Tables of sample eigenvalues are included. (SLD)

Problems of definition in estimation in evaluation research were studied through a survey of homeless persons in Cook County (Illinois) based on 481 interviews. Differences arising from the following four population definitions are presented: (1) traditional homeless; (2) marginally housed; (3) social isolates; and (4) total of these categories.…

For successful classification of children with attention deficit-hyperactivity disorder, major issues include (1) the need for explicit studies of identification criteria; (2) the need for systematic sampling strategies; (3) development of hypothetical classifications; and (4) systematic assessment of reliability and validity of hypothetical…