Hilton (2006) criticises the PIRLS (Progress in International Reading Literacy Study) tests and the survey conduct, raising questions about the validity of international surveys of reading. Her criticisms fall into four broad areas: cultural validity, methodological issues, construct validity and the survey in England. However, her criticisms are…

Humans and animals learn from experience by reducing the probability of sampling alternatives with poor past outcomes. Using simulations, J. G. March (1996) illustrated how such adaptive sampling could lead to risk-averse as well as risk-seeking behavior. In this article, the author develops a formal theory of how adaptive sampling influences risk…

A common approach to needs analysis involves the development of a self-report questionnaire administered to members of the intended audience. Such an approach poses a problem however: Concern for data reliability demands polling as many respondents as possible, while concern for cost-effectiveness dictates minimizing the size of the sample. The…

Investigated empirically through post mortem item-examinee sampling were the relative merits of two alternative procedures for allocating items to subtests in multiple matrix sampling and the feasibility of using the jackknife in approximating standard errors of estimate. The results indicate clearly that a partially balanced incomplete block…

In a post-mortem study of item sampling, 1,050 examinees were divided into ten groups 50 times. Each time, their papers were scored on four different sets of item samples from a 150-item test of academic aptitude. These samples were selected using (a) unstratified random sampling and stratification on (b) content, (c) difficulty, and (d) both.…

Three issues need to be decided in the design stage of a longitudinal intervention study: the number of persons, the number of repeated measurements per person, and the duration of the study. The degree to which polynomial effects vary across persons and the drop-out pattern also influence the statistical power to detect intervention effects. This…

Sampling experiments utilizing field portable instruments are instructional since students collect data following regulatory protocols, evaluate it, and begin to recognize their civic responsibilities upon collecting useful data. A lead-in-soil experiment educated students on a prevalent exposure pathway. The experimental site was a pre-1950…

This study examined validity evidence for the Australian version of the Neighborhood Environment Walkability Scale (NEWS-AU). A stratified two-stage cluster sampling design was used to recruit 2,650 adults from Adelaide (Australia). The sample was drawn from residential addresses within eight high-walkable and eight low-walkable suburbs matched…

Background: Recruiting schools into a matched-pair randomized control trial (MP-RCT) to evaluate the efficacy of a school-level prevention program presents challenges for researchers. We considered which of 2 procedures would be most effective for recruiting schools into the study and assigning them to conditions. In 1 procedure (recruit and…

Research with general knowledge items demonstrates extreme overconfidence when people estimate confidence intervals for unknown quantities, but close to zero overconfidence when the same intervals are assessed by probability judgment. In 3 experiments, the authors investigated if the overconfidence specific to confidence intervals derives from…

This research examines the utility of the s-x[superscript 2] statistic proposed by Orlando and Thissen (2000) in evaluating item fit for multidimensional item response models. Monte Carlo simulation was conducted to investigate both the Type I error and statistical power of this fit statistic in analyzing two kinds of multidimensional test…

A critical conceptual analysis of the South African Higher Education context reflects the lack of a structural and functional framework for the conceptualisation of community engagement (CE) in higher education. The purpose of this article is to explore a framework and model for the conceptualisation of CE for a better understanding of community…

A two-group classification procedure for multivariate binary data is presented and discussed for the case of independent samples. An empirical example is provided. (Author/JKS)

Defines a sampling taxonomy that shows the differences between and relationships among the bootstrap, the jackknife, and the randomization test. Demonstrates the usefulness of the taxonomy for teaching the goals and purposes of resampling schemes and presents univariate and multivariate examples. (SLD)

Describes the one-sample runs test, which is used to identify a nonrandom pattern in a sequence of dichotomous elements. Demonstrates that this test is incapable of signaling departures from randomness with run lengths of two. Such run lengths generate a unique category of anomaly in the overall performance of the test. (SLD)