Standardizing aspects of assessments has long been recognized as a tactic to help make evaluations of examinees fair. It reduces variation in irrelevant aspects of testing procedures that could advantage some examinees and disadvantage others. However, recent attention to making assessment accessible to a more diverse population of students…

Purpose: The main aim of this paper is to develop guidelines on the critical issues to consider in research design in an action research (AR) environment for SME network capability development. Design/methodology/approach: The issues in research design for AR studies are developed from the authors' experience in running learning sets but, in…

While measurement precision is relatively easy to establish for single tests and assessments, it is much more difficult to determine for decision making with multiple tests on different subjects. This latter is the situation in the system of final examinations for secondary education in the Netherlands and is used as an example in this paper. This…

Psychometric practice does not always converge with the advances of psychometric theory. In order to investigate this gap, the authors focus on the 10 most used psychological tests in Europe, as identified by recent surveys. The article analyzes test manuals published in 6 different European countries for these 10 most used tests. A total of 32…

Several current international comparative large-scale assessments of educational achievement (ICLSA) make use of "Rasch models", to address functions essential for valid cross-cultural comparisons. From a historical perspective, ICLSA and Georg Rasch's "models for measurement" emerged at about the same time, half a century ago. However, the…

In an attempt to restore the symmetry and balance between the study of person and item variation, this paper presents a novel methodology construct specification equations, which allows one to ascertain from the lawful behavior of items what an instrument is measuring. (Author/PN)

Mastery learning strategies and criterion referenced measurement tools perform a selective function in the classroom. The selective approach within the philosophical role of schools is discussed in terms of limited educational employment, competition, talent distribution, and the suggested attributes of good testing. (CM)

Discussed are nine questions regarding standard setting issues in educational testing: (1) Should normative or content-referenced standards be used? (2) Different standard setting methods yield different results. Does this finding present a problem? (3) Assess the adequacy of the grounding of various methods of standard setting in psychological…

This paper was prepared for school officials and researchers who plan to conduct an assessment of student writing but have limited field experience with this activity. The paper identifies twelve critical questions assessors should consider, and it explores issues involved in reaching a decision about each from the perspectives of measurement…

Continuing attention to test theory, test development, test interpretation and use, test monitoring and control, test consumer education, and the social and political consequences of testing is suggested as the primary concern of the National Council on Measurement in Education (NCME). (CM)

The thesis of this paper is that the decision to use one of three approaches to unit-of-analysis in educational research should be based on substantive considerations, not statistical factors. In addition to the commonly used "total analysis" (regression analysis across individuals), the within and between analyses are inherent in the…

Confusion in the terminology used in criterion-referenced measurement specifications and development and standard setting and the attendant role of cut-off scores are shown to need practical clarification through psychometric research on test applications and consequences. (CM)

Interest inventories have been used extensively in high schools and universities to help students make career choices. To determine whether interest inventories aid students with their career development toward their college major and occupational choice, students were assigned to one of six interest inventory groups: Strong-Campbell (N=44); Kuder…

Using the analogy of temperature measurement, the Rasch model is presented with arguments for its adoption as the basic scaling technique for achievement measures. Three extensions of the Rasch model for more complex testing are developed. Test development for the British national assessment program and the promise of item banking are also…

Claims that standards-based tests neither measure skills and knowledge accurately nor help educators do a better instructional job. The article offers suggestions in four areas to make the tests contribute to improved instruction: measurement of content standards; descriptions of standards; standard-by-standard reporting; and locally administered…