Explores how to achieve rigor in applying methodology to research questions regarding quantitative approaches, specifically regarding statistical analysis, measurement, and sample decisions. (SR)

Responds to Biskin's comments (this issue) on the significance test controversy. Highlights areas of agreement (importance of replication evidence, importance of effect sizes) and disagreement (influence of sample size, evaluation of populations vs. samples, significance of Carver's article). Includes further recommendations for reporting research…

A "fact sheet" is defined as a single two-sided sheet (or one-page folded brochure) that briefly describes all major aspects of a scientific survey or poll in nontechnical terms. A fact sheet can be used to plan all phases of a survey, from clarifying purpose, to distributing results. A fact sheet may be used as a communication tool in…

Discussion of supplemental speech sampling for in-depth phonological analysis in the assessment of children with phonological disorders focuses on how to evaluate a given word list in terms of a set of criteria for a detailed phonological analysis. Suggestions are provided for sample supplementation for two frequent areas of difficulty. (Contains…

Reviews general approaches to job analysis and considers methodological issues related to sampling and the development of rating scales used to measure and describe a profession or occupation. Evaluates the usefulness of different types of test plans and describes judgmental and empirical methods for using practice analysis data to help develop…

Describes the use of critical multiplism to evaluate the advantages and disadvantages of random sampling and deliberate sampling for heterogeneity. Suggests a model for using deliberate sampling for heterogeneity when the population parameters are unknown. Applies this model to a study of the psychosocial rehabilitation workforce. (SLD)

This article reviews indicators used by researchers to select samples of expert teachers. Reflecting initially on the broader expertise literature and then focusing on studies of teaching expertise, the authors identify criteria used to select expert teachers that fall under one or more of the following marker categories: (a) years of experience,…

This article reviews several basic statistical tools needed for modeling data with sampling weights that are implemented in Mplus Version 3. These tools are illustrated in simulation studies for several latent variable models including factor analysis with continuous and categorical indicators, latent class analysis, and growth models. The…

Several techniques exist to automatically put together a test meeting a number of specifications. In an item bank, the items are stored with their characteristics. A test is constructed by selecting a set of items that fulfills the specifications set by the test assembler. Test assembly problems are often formulated in terms of a model consisting…

Monte Carlo methodologies are frequently applied to study the sampling distribution of the estimated proficiency level in adaptive testing. These methods eliminate real situational constraints. However, these Monte Carlo methodologies are not currently supported by the available software programs, and when these programs are available, their…

There is need for objective and reliable single-case research (SCR) results in the movement toward evidence-based interventions (EBI), for inclusion in meta-analyses, and for funding accountability in clinical contexts. Yet SCR deals with data that often do not conform to parametric data assumptions and that yield results of low reliability. A…

The few studies focusing on the relationships between higher education expenditures and student outcomes have produced contradictory results. This study hypothesized that the lack of consistent relationships is a function of the fact that the effects of expenditures on outcomes are mediated by student engagement. Furthermore, it is expected that…

Meehl's taxometric method was developed to distinguish categorical and continuous constructs. However, taxometric output can be difficult to interpret because expected results for realistic data conditions and differing procedural implementations have not been derived analytically or studied through rigorous simulations. By applying bootstrap…

The purpose of this study was to determine whether key elements of high school service learning programs (HSSLPs) cited in the literature were viewed as important by stakeholders in HSSLPs that included students with and without disabilities. Focus groups were conducted with five inclusive HSSLPs selected through purposeful sampling procedures.…

Middle school students' experiences at after-school programs were compared as they participated in different types of activities and with different social partners. The students (N = 165) attended eight programs in three Midwestern states. A total of 1,596 experiences were randomly sampled using the Experience Sampling Method (ESM) during 1 week…