It is meaningful to create a comprehensive score to extract information from mass continuous data when they measure the same latent concept. Therefore, this study adopts the logic of psychometrics to conduct scales on continuous data under the Rasch models. This study also explores the effect of different data discretization methods on scale…

Background: Peer assessment has played an important role in large-scale online learning, as it helps promote the effectiveness of learners' online learning. However, with the emergence of numerical grades and textual feedback generated by peers, it is necessary to detect the reliability of the large amount of peer assessment data, and then develop…

This study aims to conduct differential item functioning analyses in the context of cognitive diagnosis assessments using various formulations of the Wald test. In implementing the Wald test, two scenarios are considered: one where the underlying reduced model can be assumed; and another where a saturated CDM is used. Illustration of the different…

State education departments find themselves pressured to reduce costs while improving student performance. To do so, state education departments must measure the performance of each school district in an objective, data-informed manner. We present a benchmarking methodology and illustrate its application in New York State school districts. We…

With the development of PC, internet as well as mobile devices, we are facing a data exploding era. On one hand, more and more features can be collected to describe the data, making the size of the data descriptor larger and larger. On the other hand, the number of data itself explodes and can be collected from multiple resources. When the data…

In this book, best-selling author Susan M. Brookhart helps teachers and administrators understand the critical elements and nuances of assessment data and how that information can best be used to inform improvement efforts in the school or district. Readers will learn: (1) What different kinds of data can--and cannot--tell us about student…

This paper discusses methods for benchmarking vocational education and training colleges and presents results from a number of models. It is conceptually difficult to benchmark vocational colleges. The colleges typically offer a wide range of course programmes, and the students come from different socioeconomic backgrounds. We solve the…

For transfer students, the transfer of credit between institutions creates a barrier to graduation as students' time and money is ultimately wasted when courses do not successfully transfer as credit applicable toward degree requirements at the receiving institution. Understanding the extent to which courses at your institution transfer to other…

This research provides the first review of publicly available assessment information found on Association of Research Libraries (ARL) members' websites. After providing an overarching review of benchmarking assessment data, and of professionally recommended assessment models, this paper examines if libraries contextualized their assessment…

The purpose of this chapter is to discuss the conceptual, methodological, and statistical challenges in selecting appropriate peer institutions for comparative purposes. The authors' approach embraces a Western scientific tradition that physical things and phenomena can be "reduced into a set of key variables--identifiable parts--that make key…

This study compared a value-added approach to school accountability to the currently used metrics of accountability in California of Adequate Yearly Progress (AYP) and Academic Performance Index (API). Five-year student panel data (N?=?53,733) from 29 elementary schools in a large California school district were used to address the research…

Institutions of higher education are under pressure to be accountable for their expenditures while demonstrating their effectiveness. Through structural equation modeling, a relationship was found between expenditures and the efficiency and effectiveness of an institution, and an optimal expenditure level was found that maximized an institution's…

Peter Wylie is a man of many contradictions: a statistician and a storyteller, an introvert who loves an audience, and a self-described data geek with a passion for his work and the people it helps. Wylie is one of the pioneers of predictive modeling, the statistical analysis that uses data to drive educational institutions and nonprofits toward…

In this chapter, the author proposes a model for assessing institutional effectiveness. The Volkwein model for assessing institutional effectiveness consists of five parts that summarize the steps for assessing institutions, programs, faculty, and students. The first step in the model distinguishes the dual purposes of institutional effectiveness:…

Developed to identify and qualitatively assess computer system evaluation techniques for use during acquisition of general purpose computer systems, this document presents several criteria for comparison and selection. An introduction discusses the automatic data processing (ADP) acquisition process and the need to plan for uncertainty through…