Recent negotiations of 'data' in schools place focus on student assessment and NAPLAN. However, with the rise in artificial intelligence (AI) underpinning educational technology, there is a need to shift focus towards the value of teachers' digital data. By doing so, the broader debate surrounding the implications of these technologies and rights…

As we design increasingly complex systems, we run up against fundamental limitations of human imagination. To support practice, it becomes essential to use authentic data and algorithms as design materials to augment designers' intuitions. Recent work has explored some dimensions of using data as a design material, suggesting the contours of a new…

One of a series of research reports examining objective principles successfully used in other fields which can lend integrity and legitimacy to evaluation, this report presents an overview of operations research (OR) as a potential source of evaluation methodology. The nature of the methods common to this discipline are summarized and the…

Many important human activities involve accomplishing goals without a script. There is no formula for true problem-solving. Heuristic, cognitive "rules of thumb" are the problem-solver's best guide. Learners should understand heuristic tools such as means-end analysis, working backwards, successive approximation, and external representation. Since…

The Galois-lattice is a graphic method for representing all possible developmental phases to reach a given total knowledge via different partial knowledge structures. Algorithms are proposed for incorporating statistical analysis into the Galois-lattice method. A comparison to the Rasch model and application for educational research are given. (BS)

Mislevy (1984, 1985) introduced an EM algorithm for estimating the parameters of a latent distribution model that is used extensively by the National Assessment of Educational Progress. Second order asymptotic corrections are derived and applied along with more common first order asymptotic corrections to approximate the expectations required by…

A marginal maximum likelihood estimation algorithm is presented for the ordered partition model of M. Wilson that does not require the set of available responses to be fully ordered. The model and its estimation algorithm are illustrated in a comparison of alternative scoring schemes for open-ended science items. (SLD)

The reasons people most often give for the failures of U.S. schools involve poverty, racial inequality, and a host of social problems. This paper argues that even if all these conditions were remedied, the schools would not produce many more people with the ability to think than they do today. Teachers, who are usually able to think, do not know…

Three different applications of the testlet concept are presented, and the psychometric models most suitable for each application are described. Difficulties that testlets can help overcome include (1) context effects; (2) item ordering; and (3) content balancing. Implications for test construction are discussed. (SLD)

A paradigm for the recalibration of teacher-made assessment that assesses and evaluates in one operation is formulated. The effort to make the classroom the primary source of educational research activity is contingent on redefining educational research as empirical and not experimental. This emphasizes that the empirical analysis of instructional…