Data Envelopment Analysis (DEA) is a widely adopted non-parametric technique for evaluating R&D performance. However, traditional DEA models often struggle to provide reliable solutions in the presence of data uncertainty. To address this limitation, this study develops a novel robust super-efficiency DEA approach to evaluate R&D…

Identifying effective literacy interventions for teachers of very young children is important, but it is not easy. In this case study, we share our experiences implementing a quasi-experimental evaluation of an early literacy program. We describe the design and context of the study and discuss three key issues that we encountered with data…

Science instructors are increasingly incorporating teaching techniques that help students develop core competencies such as critical-thinking and communication skills. These core competencies are pillars of career readiness that prepare undergraduate students to successfully transition to continuing education or the workplace, whatever the field.…

Shortly after we published "Addressing Flawed Research in Developmental Education" (2012) in the "Journal of Developmental Education," Thomas Bailey, Shanna Smith Jaggars, and Judith Scott- Clayton from the Community College Research Center (CCRC) wrote a response rebutting several of our claims. Though their response corrects…

Since its founding in 1947, ETS has conducted a significant and wide-ranging research program that has focused on, among other things, psychometric and statistical methodology; educational evaluation; performance assessment and scoring; large-scale assessment and evaluation; cognitive, developmental, personality, and social psychology; and…

Extension educators need simple and accurate evaluation tools for program evaluation. This article explains how to use aspiration as an outcome indicator in Extension evaluation and introduces a practical evaluation tool. Aspiration can be described as the readiness for change. By recording participants' levels of aspiration, we will be able to…

This dissertation comprises three papers that propose, discuss, and illustrate models to make improved inferences about research questions regarding student achievement in education. Addressing the types of questions common in educational research today requires three different "extensions" to traditional educational assessment: (1)…

In the modern world, higher education is transitioning from enrollment mode to recruitment mode. This shift paved the way for institutional research and policy making from historical data perspective. More and more universities in the U.S. are implementing and using enterprise resource planning (ERP) systems, which collect vast amounts of data.…

Establishing an online community of professional learners was one component of a multi-year professional development project with an overall goal of improving the ability of career and technical educators to use and interpret technical assessment data. Educators from five states and nine different schools participated in a research-based workshop…

The Office of Planning, Research and Evaluation (OPRE), a unit within the Administration for Children and Families (ACF), is responsible for advising the Assistant Secretary for Children and Families on increasing the effectiveness and efficiency of programs to improve the economic and social well-being of children and families. In collaboration…

Providing remedial (also known as developmental) education is the primary way colleges cope with students who do not have the academic preparation needed to succeed in college-level courses. Remediation is widespread, with nearly one-third of entering freshman taking remedial courses at a cost of at least $1 billion per year. Despite its…

Schools today are more data rich than ever, requiring staff members to develop their data literacy--that is, their knowledge of how to use assessment data with other types of data to identify areas of effectiveness and to target instructional improvement efforts. Administrators and teachers are expected to use combinations of data (diagnostic and…

Countries that begin implementing the Intel[R] Teach to the Future Essentials course after March of 2006 are required to collect data using the Intel[R] Teach Essentials End of Training Survey to help support program improvement. This End of Training evaluation toolkit provides guidelines on: (1) End of Training Survey administration; (2) The…

Hypothesis generation and testing is outlined as an additional domain for program evaluators. Program evaluation involves a thorough analysis of the processes that contribute to change (or a lack of change) among program recipients. This process of change is analyzed in two ways: (1) treating programs as naturally occurring field studies; and (2)…

Formative evaluation focuses on program modification based on ongoing measurement of student progress. The literature on formative evaluation for mildly handicapped students indicates that four measurement dimensions are critical: (1) focus of measurement; (2) frequency of measurement; (3) data display; and (4) data utilization methods. (Author/CB)