The second version of Kaiser's Measure of Sampling Adequacy (MSA[subscript 2]) has been widely applied to assess the factorability of data in psychological research. The MSA[subscript 2] is developed in the population and little is known about its behavior in finite samples. If estimated MSA[subscript 2]s are biased due to sampling errors,…

Many methods are used to measure interrater reliability for studies where each target receives ratings by a different set of judges. The purpose of this study is to explore the use of hierarchical modeling for estimating interrater reliability using the intraclass correlation coefficient. This study provides a description of how the ICC can be…

Data collected from surveys can result in hundreds of variables and thousands of respondents. This implies that time and energy must be devoted to (a) carefully entering the data into a database, (b) running preliminary analyses to identify any problems (e.g., missing data, potential outliers), (c) checking the reliability and validity of the…

The authors' purpose was to investigate the effect of origami-based instruction on elementary students' spatial ability. The students' self-reported perceptions related to the origami-based instruction were also examined. Data was collected via purposive sampling techniques from students enrolled in a private elementary school. A spatial ability…

The purpose of this research was to investigate the predicting effect of high school students' metacognitive skills, exam anxiety and academic success levels upon their psychological well-being in a provincial center with a medium-scale population in Eastern Anatolian Region. The research group included totally 251 high school students including…

Multiple matrix sampling is a sampling design in which both test items and examinees are randomly sampled from their respective populations. This study was designed to develop and assess a method for computing an estimate of a correlation coefficient when a multiple matrix sampling design is used. The examinee populations included 212 third-grade…

The purpose of this paper is to prove that one currently recommended method of obtaining the reliability of an instrument defined on a population of aggregate units is invalid. This method randomly splits the aggregate into two halves, correlates the two half unit scores by a Pearson product moment correlation coefficient, and corrects the…

The purpose of this study was to gather empirical evidence to compare the reliabilities and concurrent validities of multiple choice and true-false tests that were written to measure understandings and relationships in the same content areas. (Author)

The present study suggests that although the reliability of an academic aptitude test given under formula-score condition can be increased substantially through empirical option weighting, much of the increase is due to the capitalization of the keying procedure on omitting tendencies which are reliable but not valid. (Author)

This report gives some simple examples of stability for one factor and 2 x 2 factorial analysis of variance, reliability and correlations. The findings are very different: from superstability (no transformation whatsoever can change the result) to almost total instability. This is followed by a discussion of applications to multivariate analysis,…

The pretest-posttest design referred to as Design 2 by Campbell and Stanley (1963) is commonly used in educational research and evaluation. The tenability of the assumption of a zero population difference commonly used with this design is questioned. A nonzero population estimate based on the mean difference observed in test-retest reliability…

This self-instructional manual for psychological assessment focuses on the following topics: (1) general statistics, (2) central tendency, (3) random, continuous, and discrete variables, (4) variability, (5) measuring variability, (6) sampling, (7) derived scores, (8) covariation, (9) reliability and validity, and (10) standard error of…

A model and computation procedure based on classical test score theory are presented for determination of a correlation coefficient corrected for attenuation due to unreliability. Delta and Monte Carlo method applications are discussed. A power analysis revealed no serious loss in efficiency resulting from correction for attentuation. (TJH)