Classical test theory is based on the concept of a true score for each examinee, defined as the expected or average score across an infinite number of repeated parallel tests. In most cases, there is only a score from a single administration of the test in question. The difference between this single observed score and the underlying true score is…

Previous studies have indicated that the reliability of test scores composed of testlets might be overestimated by conventional item-based reliability estimation methods (R. Thorndike, 1953; A. Anastasi, 1988; S. Sireci, D. Thissen, and H. Wainer, 1991; H. Wainer and D. Thissen, 1996). This study used generalizability theory to investigate the…

Current methods of obtaining reliability coefficients for mastery tests are laborious from a practitioner's perspective. Some methods require two test administrations; while others require access to computer facilities and/or advanced measurement and statistical procedures. This report provides tables from which practitioners can read such…

The purpose of the study was to compare reliability estimates for a test composed of stimulus-dependent testlets as derived from item scores, testlet scores, and under the univariate generalizability theory and multivariate generalizability theory designs, as well as to determine the influence of the number of testlets and the number of items per…

Findings of this 20-year longitudinal study support Kohlberg's theoretical predictions of invariant structural consistency of subjects' responses to hypothetical moral dilemmas. Subjects were 58 American males chosen in 1955 according to age, social class and sociometric status. They were 10, 13, or 16 years of age at Time 1. Half of each age…

The short-term (45-day) stability of the Adjustment Scales for Children and Adolescents (P. McDermott, N. Marston, and D. Stott, 1993) was studied with 51 first and fifth graders, seven of whom were classified as "exceptional/disabled." Significant test-retest reliability coefficients were obtained, and mean differences from test to…

Bootstrap analysis, both for nonparametric statistical inference and for describing sample results stability and replicability, has been gaining prominence among quantitative researchers in educational and psychological research. Procedurally, however, it is often quite a challenge for quantitative researchers to implement bootstrap analysis in…

Two studies were made of the validity and reliability of a Learning Style Inventory (LSI) for postsecondary deaf individuals. The study's a priori definition of learning style was multidimensional and included aspects of field dependence/independence and perceived locus of Nineteen students were administered the LSI and immediately interviewed on…

The Alpha Omega Completed Sentence Form (AOCSF) was developed to identify and measure a person's adaptational approaches to information concerning their own death or the possible death of a significant other. In contrast to the Kubler-Ross stage theory, the adaptational approach recognizes a person's capacity to assimilate new information which…

Job analysis has played a fundamental role in developing and validating licensure and certification examinations, but research on what constitutes reliable and valid job analysis data is lacking. This paper examines the reliability and validity of job analysis survey results. Generalizability theory and the multi-facet Rasch item response theory…

This study examined the internal consistency of the Student Satisfaction Inventory (SSI) (L. Schrener, S. Juillerat, and Noel-Levitz Group, 1997) and the latent structures of the instrument. The SSI is an instrument that measures students' satisfaction with their college experiences. The SSI was administered to 251 students randomly selected from…

This paper reports the results of generalizability theory (G) analyses done for new writing and speaking tasks for the Test of English as a Foreign Language (TOEFL). For writing, a special focus was placed on evaluating the impact on the reliability of the number of raters (or ratings) per essay (one or two) and the number of tasks (one, two, or…

The Personal Preferences Self-Description Questionnaire (PPSDQ) (B. Thompson) was developed to measure personal preferences with regard to Jungian psychological types. Instruments in this area are among the most popular measures used in education and psychology; the measures are used in matching teaching and learning styles, in individual…

Two studies investigated the relationships between readability, prior knowledge, and interest in the material being read. In the first study, 169 college freshmen read cloze passages of materials from the Nelson-Denny Reading Tests, then one week later read the whole passages and completed the related multiple choice questions. A control group…

This paper considers, from a theoretical point of view, two measurement approaches used in measuring success and failure in skills tests in physical education. The first, "fixed length" (FL) testing, entails counting the number of successful performances in a fixed number of trials. The second, "trials-to-criterion" (TTC)…