Clear descriptions of job expertise are required to support applications and improvements in personnel training and job performance. This report describes a practical approach to task analysis that integrates the issues, content, and methods of cognitive science and personnel psychology. Cognitively oriented task analysis employs a breadth, then…

Norm-referenced tests yield information regarding a student's performance in comparison to a norm or average of performance by similar students. Norms are statistics that describe the test performance of a well-defined population. The process of constructing norms, called norming, is explored briefly in this paper. Some of the most widely reported…

This paper proposes a model to establish which criteria are considered by stakeholders as valid for evaluating a program. The model is developed with the aim of increasing the credibility and use of evaluations. Stakeholders are involved in the identification of potential evaluation criteria, and ratings of validity and priority are used as the…

In the periodic testing environment associated with conventional paper-and-pencil tests, the frequency with which items are seen by test-takers is tightly controlled in advance of testing by policies that regulate both the reuse of test forms and the frequency with which candidates may take the test. In the continuous testing environment…

A study investigated the reliability and validity of a measure of imagery vividness appropriate for young children. A questionnaire instrument consisting of 21 Likert-type items was developed and administered to 380 third- through sixth-grade children in a lower-middle to upper-middle socioeconomic population in southern California. Items in the…

The design of vocabulary tests, particularly for English as a Second Language, is discussed. The discussion is intended to help language teachers with little or no knowledge of testing gain a better understanding of vocabulary testing. First, a set of principles for guiding the writing of vocabulary tests are outlined, presented in the form of…

The Certificates of Foreign Language Proficiency are general purpose tests of language use designed for the adult learner in Finland. This paper deals with the techniques of validation used when designing the test specifications and implementing these into the first versions of the tests. The data comes from the development of tests in one…

The procedures for the construction of the Dutch national exams of reading comprehension and for setting cut-off scores have remained roughly unchanged over 20 years. Construction procedures are characterized by thorough screening rather than pretesting; cut-off scores are influenced by procedures and percentages fails rather than by equating. Two…

While the conceptual change model of learning has contributed much to our understanding of how children learn science, recent criticisms of the model point out its lack of attention to motivational issues. This paper examines one such motivational construct of importance to the model: epistemic motivation. After a description of the construct, we…

A diagnostic testing system managed by microcomputer was evaluated in actual use at the upper elementary level. Two tests specifically designed to yield diagnostic indicators of erroneous performance were utilized, one a test of pronoun usage, the other a test of reading comprehension. The results are interpreted from the standpoint of the…

This digest discusses the advantages and disadvantages of using item banks, and it provides useful information for those who are considering implementing an item banking project in their school districts. The primary advantage of item banking is in test development. Using an item response theory method, such as the Rasch model, items from multiple…

Although computerized adaptive tests acquire their efficiency by successively selecting items that provide optimal measurement at each examinee's estimated level of ability, operational testing programs will typically consider additional factors in item selection. In practice, items are generally selected with regard to at least three, often…

Many textbooks in educational measurement and classroom assessment have chapters devoted to specific item formats. There may be attempts to relate one item format to another, but the chapters and item formats are largely seem as distinct entities with only loose and uncertain connections. This paper synthesizes these discussions. An item format…

This paper discusses the development of instruments to measure individual differences in behavior during infancy. The Infant Temperament Questionnaire (ITQ), which was designed to measure the temperament dimensions identified by the New York Longitudinal Study (NYLS), constituted the methodological starting point in the search for a dimensional…

The development of the Cambridge Assessment of Spoken English (CASE) is reviewed, with particular reference to the trialling and validation of the rating scales. The objectives of the test are to assess an individual's ability to produce and process spoken English; demonstrate the ability to communicate in English through the use of grammatical,…