The student evaluation of teaching process is generally thought to produce reliable results. The consistency is found within class and instructor averages, while a considerable amount of inconsistency exists with individual student responses. This paper reviews these issues along with a detailed examination of common measures of reliability that…

In this article, I review and discuss the work presented in this special issue while focusing on a number of issues that warrant further investigation in validation research. These issues pertain to the nature of the validation processes, the processes and mechanisms that support validation during comprehension, the factors that influence…

Database files and additional log files of Learning Management Systems (LMSs) contain an enormous volume of data which usually remain unexploited. A new methodology is proposed in order to analyse these data both on the level of both the courses and the learners. Specifically, "regression analysis" is proposed as a first step in the…

Studies of data use illuminate ways in which education professionals have used test scores and other evidence relevant to students' learning--in action in their own contexts of work--to make decisions about their practice. These studies raise instructive challenges for a validity theory that focuses on intended interpretations and uses of test…

Purpose: The aim of this work is to evaluate Greek newspaper websites using clustering and a number of criteria obtained from the Alexa search engine. Furthermore, a recommendation approach is proposed for matching Greek online newspapers with the profiles of potential readers. The paper presents the implementation and validation of a recommender…

This article reports from an empirical study on the affordances and constraints for using staged socio-political debates for authentic summative assessment of scientific literacy. The article focuses on conditions for student participation and what purposes emerge in student interaction in a socio-political debate. As part of the research project,…

Increasing demands for accountability from both the public and the government have resulted in increasing pressure for higher education professionals to use data to support their choices. There is significant speculation that professionals at all levels of education lack the knowledge to implement data-driven decision making. However, empirical…

Quality measurement serves as a foundation for child care Quality Rating and Improvement Systems (QRIS). Understanding the variation that exists in quality measurement, the different contexts in which states make decisions, and the factors that play into their decisions can help administrators identify where their state may fall along the spectrum…

With a grant from the Council of the Great City Schools' Senior Urban Education Research Fellowship Program, the authors began a project designed to identify the roots of the dropout problem in the District of Columbia by identifying middle grades students' exhibiting behaviors associated with dropping out of high school. Their plan was to use DC…

Effective teaching has long been an issue of national concern, but in recent years focus on the effectiveness of programs to produce high-quality teachers has sharpened. Long-standing achievement gaps persist despite large-scale legislative changes at the federal and state levels, and American students continue to show poorer performance on…

In empirical research, methods adopted and methods rejected should be stated so that readers and other researchers are convinced of its pedigree and usefulness. (IR)

Evaluation studies on educational questions attempt to provide answers in the form of conclusions or inferences which are derived from the information collected. Valid inferences are a result of careful research design for the study, and may be causal, descriptive, value-oriented, or probabilistic. Basic steps in designing an evaluation study are…

The purpose of the report was to examine the readability of the Occupational Information Access System (OIAS) QUEST questionnaire and the validity of independent client use of the questionnaire as an information gathering device. Readability formulas rate the QUEST questionnaire "easy" or "fairly easy" and they rank the…

Direct observation is consistent with the multidimensional approach specified in the Education for All Handicapped Children Act. Furthermore, it is directly related to psychoeducational planning, consultation, and intervention, and it is a credible information source. (Author/CP)