Policymakers have expressed increased interest in program-level higher education accountability measures as a supplement to, or in place of, institution-level metrics. But it is unclear what these measures should look like. In this report, we assess the ways program-level data could be developed to facilitate federal accountability. Evidence shows…

Background: Traditional survey efforts to gather outcome data at scale have significant limitations, including cost, time, and respondent burden. This pilot study explored new and innovative large-scale methods of collecting and validating data from publicly available sources. Taking advantage of emerging data science techniques, we leverage…

There is a need for a holistic usability evaluation framework that accommodates social constructivist online courses. Social knowledge construction may not be adequately evaluated using current frameworks. This qualitative research study examined the usability needs of a social constructivist online course. Data from an online course were analyzed…

In the current climate of increasing fiscal and clinical accountability, information is required about overall program effectiveness using clinical data. These requests present a challenge for programs utilizing single-subject data due to the use of highly individualized behavior plans and behavioral monitoring. Subsequently, the diversity of the…

The debate surrounding teacher quality often fails to differentiate effectively between teacher-preparation providers. This failure also extends to distinguishing between teachers prepared in traditional campus-based accredited programs from those prepared in unaccredited campus-based programs. This paper compares assessment infrastructure and…

This "What Works Clearinghouse Procedures and Standards Handbook (Version 3.0)" provides a detailed description of the standards and procedures of the What Works Clearinghouse (WWC). The remaining chapters of this Handbook are organized to take the reader through the basic steps that the WWC uses to develop a review protocol, identify…

Detailed descriptions of the data analysis procedures used in Project EDNEED (Empirical Determination of Nationally Essential Educational Data) are contained in this volume, the last of a five-volume final report. Results of the application of procedures and a narrative interpretation of the results are included. Priority rankings of 323 questions…

Based on a theoretical model of program development, this taxonomy of evaluation relates six evaluation objectives or purposes to nine methodological alternatives. Use of the taxonomy may increase the efficiency of evaluation, improve communication, and assist in the choice of a methodology that is appropriate to the evaluation purposes.…

Thirty-three Parent-Child Centers (PCCs) are grouped into five clusters according to thematic orientation of content or intent for parents' and children's programs in order to provide models which may be viewed as strata in selecting Centers as sampling points for Phase II of the national PCC evaluation--an in-depth study of project impact on…

Social area analysis (SAA) is defined, and its conceptual roots and principal applications identified. The utility of SAA is assessed by reviewing use of demographic data among several disciplines. Authors review seminal and recent contributions to the field. Ecological fallacies and other problematic facets of SAA are considered. (Author/DWH)

Relevant conceptual frameworks must guide data collection and analysis if data are to be useful to service program planners and administrators. Such frameworks are increasingly important in the systematic assessment of the total array of services in a planning region. This paper describes a two-dimensional classification matrix developed in…

Theory behind modern evaluative bibliometric techniques is reviewed at three levels: (1) policy application; (2) strategic analysis; and (3) tactical analysis. New techniques developed at each level and limitations of each approach are discussed. At all levels, the process begins with assembling data and then moves to a data-based evaluation. (SLD)

This conference was held to enhance communication between the Office of Special Education Programs (OSEP) and State education agency staffs, and to furnish information and technical assistance to State agencies in the areas of data management and improvement of data reliability, validity, and comparability. Abstracts of presentations include the…