We provide evidence of validity for a newly developed diagnostic competence model of operation sense, by both (a) describing the theoretically substantiated development of the competence model in close association with its use within a large-scale formative assessment and (b) providing empirical evidence for the theoretically described cognitive…

The author replies to Marx's critique of his essay, "Test Purpose and Item Type," which appears on pages 8-13 of this issue of "Canadian Journal of Education." For Marx's comments, see pages 14-19. (SJL)

A new standard setting approach is introduced, called the cognitive components approach. Like the Angoff method, the cognitive components method generates minimum pass levels (MPLs) for each item. In both approaches, the item MPLs are summed for each judge, then averaged across judges to yield the standard. In the cognitive components approach,…

The cognitive components standard setting method, recently introduced by D. McGinty and J. Neel (1996), asks judges to specify minimum levels of performance not for the test items, but for smaller portions of items, the component skills and concepts required to answer each item correctly. Items are decomposed into these components before judges…

This manual is intended to serve as a step-by-step guide to writing criterion-referenced tests. It includes directions on constructing and scoring various types of test items to measure each level of cognitive function. The manual gives a method for writing, analyzing and rewriting instructional objectives; preparing a content outline; matching…