Tailored Response Testing (TRT) is a new type of test that has demonstrated its applicability to the evaluation of human performance in a wide variety of occupations and work settings. The Navy is using TRT to measure the technical proficiency of job incumbents in three of its jobs. The methodology holds great promise for testing aboard ships as…

Issues associated with the lack of statistical skills among educational and psychological researchers are discussed. Issues are associated with accreditation standards, faculty positions for psychometric specialists, measurement curricula, and licensing organizations. The Test User Qualification Working Group has produced a model test user…

Attention deficits and attention deficit-hyperactivity disorder (AD-HD) are regarded as relatively common disorders among school-age children, but the literature reveals several confounding factors with the standard assessment techniques for the disorder. Using a structured thematic apperception technique (the TEMAS Apperception Test of G.…

The goal of this study was to assess the relative merit of various ranges and types of response scales in terms of respondent satisfaction and comfort and the nature of the elicited information in a population of seventh grade students. Three versions of an attitudinal questionnaire, each containing the same items but employing a different…

This study investigated learners' preconceptions of interactive video (IV), instructional television (ITV), and television (TV), and compared three treatment groups on learners' perceptions of invested mental effort and achievement on a test of recall and inference. The three treatments consisted of an IV lesson that included practice questions…

Two techniques for detecting differential item functioning (DIF) of test items are compared: (1) item response theory (IRT), using the three-parameter model; and (2) Mantel-Haenszel chi square techniques (MHCS). The steps necessary for identifying differentially functioning items are identified for both approaches. Using data from the 1988…

The roles of training, problem representation, and individual differences on performance of both automated (simple) and controlled (complex) process tasks were studied. The following hypotheses were tested: (1) training and cognitive style affect the representation developed; (2) training and cognitive style affect the development and performance…

Aptitude tests are defined in contrast to intelligence and achievement tests. Although aptitude tests, like intelligence tests, measure a student's overall performance across a broad range of mental capabilities, the former also often include items that measure more specialized abilities (such as verbal and numerical skills) that predict…

The appropriateness of using time limits when measuring students' competence is questionable. This study assessed whether students who had failed the College Level Academic Skills Test (CLAST) could improve their performance if they were allowed additional time on retaking the test. Subjects were 641 students who took the CLAST from fall 1982…

A new method for estimating the parameters of the normal ogive three-parameter model for multiple-choice test items--the normalized direct (NDIR) procedure--is examined. The procedure is compared to a more commonly used estimation procedure, Lord's LOGIST, using computer simulations. The NDIR procedure uses the normalized (mid-percentile)…

A study investigated the degree to which scores on content-based tests were influenced by non-content factors such as difficulty with reading, lack of confidence in responding independently to a test, and inexperience with modes of responding to multiple-choice questions. A test compiled from science, math, and social studies material in a primary…

These two reports examine the passing rates of St. Petersburg Junior College (SPJC) students on the College Level Academic Skills Test (CLAST). The first report focuses on the 549 SPJC students who took the CLAST for the first time in June 1989, while the second report offers information on the 756 SPJC students who took the CLAST in October 1989.…

Two hypotheses, the cognitive capacity hypothesis and the selective attention hypothesis, try to account for the facilitation effects of prior knowledge activation. They appear to be mutually exclusive since they predict different recall patterns as a result of prior knowledge activation. This study was designed to determine whether the two…

Use of clustering methods with data from the 1987 High School Transcript (HST) component of the 1986 National Assessment of Educational Progress (NAEP) is discussed in an attempt to persuade data analysts and researchers that they should be interested in problems traditionally turned over to samplers. Nearly all surveys used by the National Center…

In most judgmental methods for setting performance standards, content experts evaluate test items based on a conceptualization of a borderline examinee or a group of examinees. An alternative method is proposed by which judges evaluate items based on the degree of criticality regardless of content area. This classification of items serves to link…