Improving the validity and reliability of surveys is a critical part of the response to the call for improved rigor of education research, policy analysis and evaluation. Too often we create inquiry tools without validating our measures against how respondents interpret our questions, and therefore collect data of questionable quality. The purpose…

Through a description and comparison of standards for evaluation and criteria for judging naturalistic inquires some potential conflicts in using naturalistic methods are identified. Analysis of problems suggests that compromises in the use of evaluation standards and criteria for naturalistic procedures are usually necessary. (Author/JAZ)