This study utilized generalizability theory to assess the context where the National Survey of Student Engagement's (NSSE) summary measures, the Engagement Indicators, produce dependable group-level means. The dependability of NSSE group means is an important topic for the higher education assessment community given its wide utilization and usage…

The student evaluation of teaching process is generally thought to produce reliable results. The consistency is found within class and instructor averages, while a considerable amount of inconsistency exists with individual student responses. This paper reviews these issues along with a detailed examination of common measures of reliability that…

Student agency, or the ability to manage one's learning, can have significant effects on academic achievement as students take an active role in seeking and internalizing new knowledge. Students who believe that knowledge can grow over time perform better on IQ tests than students who believe intelligence is invariable (Cury, Elliot, Da Fonseca,…

Although there is a strong legislative base and perceived efficacy for multidisciplinary team decision making, limited evidence supports its effectiveness or consistency of implementation in practice. In recent research, we used the Decision Observation, Recording, and Analysis (DORA) tool to document activities and adult behaviors during positive…

In this article, I review and discuss the work presented in this special issue while focusing on a number of issues that warrant further investigation in validation research. These issues pertain to the nature of the validation processes, the processes and mechanisms that support validation during comprehension, the factors that influence…

Database files and additional log files of Learning Management Systems (LMSs) contain an enormous volume of data which usually remain unexploited. A new methodology is proposed in order to analyse these data both on the level of both the courses and the learners. Specifically, "regression analysis" is proposed as a first step in the…

Studies of data use illuminate ways in which education professionals have used test scores and other evidence relevant to students' learning--in action in their own contexts of work--to make decisions about their practice. These studies raise instructive challenges for a validity theory that focuses on intended interpretations and uses of test…

Technology can change higher education by empowering students to make an impact on the world as undergraduates. Done systematically, this would allow institutions to close the credibility gap with an increasingly dubious public. Authentic student achievements that are addressed to a "real world" audience can lead to richly detailed…

Purpose: The aim of this work is to evaluate Greek newspaper websites using clustering and a number of criteria obtained from the Alexa search engine. Furthermore, a recommendation approach is proposed for matching Greek online newspapers with the profiles of potential readers. The paper presents the implementation and validation of a recommender…

This article reports from an empirical study on the affordances and constraints for using staged socio-political debates for authentic summative assessment of scientific literacy. The article focuses on conditions for student participation and what purposes emerge in student interaction in a socio-political debate. As part of the research project,…

This dissertation is developed around two studies created with the goal of describing and quantifying current educators' knowledge and perceptions of reading assessment and subsequent data-based instructional decision making. Unique to the field, a critical component of this study is an emphasis on educators' development of "data…

The authors use data known at the time of initial enrollment to explore the first-year GPAs and second-year retention of first-generation (FGCS) and non-first-generation (non-FGCS) college students. The setting was a diverse, public, urban doctoral institution (approximately 50% FGCS and 30% minority). Multiple linear and logistic regressions run…

Increasing demands for accountability from both the public and the government have resulted in increasing pressure for higher education professionals to use data to support their choices. There is significant speculation that professionals at all levels of education lack the knowledge to implement data-driven decision making. However, empirical…

Quality measurement serves as a foundation for child care Quality Rating and Improvement Systems (QRIS). Understanding the variation that exists in quality measurement, the different contexts in which states make decisions, and the factors that play into their decisions can help administrators identify where their state may fall along the spectrum…

With a grant from the Council of the Great City Schools' Senior Urban Education Research Fellowship Program, the authors began a project designed to identify the roots of the dropout problem in the District of Columbia by identifying middle grades students' exhibiting behaviors associated with dropping out of high school. Their plan was to use DC…