Introduction: The use of averaged topic-level scores can result in the loss of valuable data and can cause misinterpretation of the effectiveness of system performance. This study aims to use the scores of each document to evaluate document retrieval systems in a pairwise system evaluation. Method: The chosen evaluation metrics are document-level…

Performance-based assessment is unquestionably superior to the instrumental rationality of high-stakes standardized testing and the audit culture that testing regimes inspire. It is more likely to engender opportunities to witness the un-measureable: vision, imagination, and compassion. Performance assessments must be culturally responsive in…

The story of the Institute for Health Professions at Cambria Heights illustrates the positive impact of using performance assessments rather than relying on the state Regents exams.

This issue's featured article, "Assessment and Learning: Fields Apart" (Baird, Andrich, Hopfenbeck, and Stobart 2017) raises issues that are of basic importance for the disciplines of assessment and teaching and learning theory. In this commentary, Alex Scharaschkin restricts his remarks to a few areas. He considers the idea of a…

Purpose: The purpose of this study was to document whether mean length of utterance (MLU[subscript S]), total number of words (TNW), clauses per sentence (CPS), and/or words per sentence (WPS) demonstrated age-related changes in children with typical language and to document the average time to collect, transcribe, and analyze conversational…

Registered nurses today are required to maintain a portfolio of evidence of their competence to practice. This evidence collection commences at undergraduate level with nursing programmes requiring portfolio's as assessments, which are often submitted in hard copy. This paper describes the outcome when a small group of tutorial staff introduced…

Inquiry-based education has been part of innovative science teaching for the last few decades. With the competence orientation now underlying many national curricula, one of the emerging questions is how the development of student competences can be fostered in the context of inquiry-based science education. One approach to supporting students in…

Building on a study conducted by the authors, this article provides strategies for teaching data literacy and outlines the case-based teaching method as an effective way of developing data-literate teachers.

This paper presents a case for the use of transaction-level data when analyzing automated online assessment results to identify knowledge gaps and misconceptions for individual students. Transaction-level data, which records all of the steps a student uses to complete an assessment item, are preferred over traditional assessment formats that…

This article offers an approach to examining differential item functioning (DIF) under its item response theory (IRT) treatment in the framework of confirmatory factor analysis (CFA). The approach is based on integrating IRT- and CFA-based testing of DIF and using bias-corrected bootstrap confidence intervals with a syntax code in Mplus.

This article responds to the dangers arising from baseline assessment in reception classes. It contrasts predictive testing which claims to ascertain each child's ability and potential with the processes of observation, documentation and discussion developed in Reggio Emilia. It explores the two very different understandings of children which they…

The search for necessary and sufficient causes of some outcome of interest, referred to as "configurational comparative research," has long been one of the main preoccupations of evaluation scholars and practitioners. However, only the last three decades have witnessed the evolution of a set of formal methods that are sufficiently…

Specifications Grading is a system of course-long student assessment based on the division of learning objectives into clearly defined skill tests or assignments. Each skill is evaluated at a mastery level, with opportunities for students to learn from their mistakes and then be re-evaluated for skill tests, or resubmit assignments. Specifications…

Recent efforts to reform K-12 science curricula, embedded within the "NRC Framework for K-12 Science Education" and the "Next Generation Science Standards," have focused on unifying core disciplinary content with crosscutting concepts that span across science disciplines and scientific practices. With these reforms comes the…

We live in an age of continual technological development. Rapidly developing technologies have found use in nearly all aspects of life. As such, it is understandable that technology has also infiltrated the field of education. Information and Communication Technology (ICT) has provided us with the technical underpinnings for distance and lifelong…