Survey-based research is vital in education and social sciences, offering insights into human behaviors and perceptions. The prevalence of such studies in medical education has risen by 33% over the past decade. Despite this growth, the utility of survey findings depends on the study design quality and measure validity. Many manuscripts are…

The second edition of the International Test Commission Guidelines for Translating and Adapting Tests was prepared between 2005 and 2015 to improve upon the first edition, and to respond to advances in testing technology and practices. The 18 guidelines are organized into six categories to facilitate their use: pre-condition (3), test development…

The article serves as a guide for researchers in developing evidence of validity using bivariate correlations, specifically construct validity. The authors outline the steps for calculating and interpreting bivariate correlations. Additionally, they provide an illustrative example and discuss the implications.

Describes a procedure for rescaling objective measures of comprehension so that they reflect amounts of accuracy of comprehension on an absolute scale. Suggests there is adequate empirical evidence supporting the validity of the rauding rescaling procedure. (RS)

The meanings of reliability and validity as they apply to standardized measures are used as a framework for applying the concepts of reliability and validity to authentic assessments. This article sees reliability as scorability and stability, whereas validity is seen as students' ability to use knowledge authentically in the field. (DB)

Suggests that the choice of validity procedures in qualitative inquiry is governed by two perspectives: the lens researchers choose to validate their studies and the researchers' paradigm assumptions. The article advances a two-dimensional framework to help researchers identify appropriate validity procedures for their studies. Nine validity…

Describes a methodology for structuring interviews with subject experts during knowledge elicitation, or knowledge acquisition, that will be useful to instructional designers. Topics discussed include a prototype knowledge editor, SNOWMAN (System for Knowledge Management); the nature of expertise; reductive bias; four interviewing strategies; and…

The sole objective of the employment interview should be to obtain and evaluate factual and verifiable information. The greater the discrepancy between the tasks of the job and the experience of the interviewee, the more critical will be the influence of the intuitive judgment of the interviewer. (Author/MLF)

Provides advice on writing a research paper when structural equation models are being used in empirical work. Focuses on what information should be reported and what can be deleted without much loss of judgment about the quality of the research and validity of conclusions. (SLD)

Aims to help instructors make more valid test questions, particularly multiple-choice ones. Emphasis is placed on multiple-choice questions to show the wealth of opportunities they offer for testing because of their uses, objectivity, and ease of grading. Discusses test scheduling, construction, and evaluation and follow-up. (CT)

Provides an approach for selecting and evaluating both group and individually administered standardized tests of reading. Reviews considerations of the quality of test development; test content; test reliability and validity; and concerns of cost and time investment. Presents sample ratings of two common instruments. (RS)

Since research conclusions derived from inappropriate statistical methodologies can lack accuracy, the article describes a technique appropriate to the heterogeneity of special needs groups in which subjects are assigned to fairly homogeneous subgroups. The technique is related to research in reading with this population. (DB)

Addresses the use of subjective judgment in research that involves statistical/quantitative methods with regard to four aspects of quantitative research: (1) design; (2) preliminary analyses; (3) general analyses; and (4) specific analyses. (Contains 37 references.) (ASK)

Compares and contrasts standards and techniques of qualitative and quantitative usability testing methodologies. Focuses on ways technical communicators can ensure rigorous tests in terms of the validity and reliability of findings, defining criteria of validity and reliability for both quantitative and qualitative methods. Presents a list of…

The main features of a multiple site, structured case study design are presented. The nature of explanatory patterns, how case study investigators pursue and recognize valid patterns, and how an analyst can apply the same logic to cross-site analysis are discussed. (Author/BW)