Educational assessment is inherently uncertain, where physiological, psychological and social factors play an important role in establishing judgements which are assumed to be "absolute". AI and other algorithmic approaches to grading of student work strip-out uncertainty, leading to a lack of inspectability in machine judgement and…

Post-secondary institutions are required to complete a variety of quality assurance activities including external program review, a process of inviting external reviewers from outside the institution to provide constructive feedback on all aspects of an academic program. While external program reviews have been completed for decades, there has…

In this paper, we present an agenda for the research directions we recommend in addressing the issues of realizing and evaluating communication in CPS instruments. We outline our ideas on potential ways to improve: (1) generalizability in Human-Human assessment tools and ecological validity in Human-Agent ones; (2) flexible and convenient use of…

To identify the dominant cultural models among parents transmitting faith to their children, we find few methodological guidelines to guide coding and analysis of semi-structured interviews. We thus developed a three-phase procedure for our research team. Phase-one follows Campbell et al. by unitizing on meanings rather than words/pages, including…

Educational Robotics is rapidly gaining attention as an effective methodology to develop skills and engage students preserving their peculiar style of learning. It is often tied together with two other methodologies, Coding and Tinkering, characterized by a similar hands-on approach. In order to fully exploit their inclusive features, teachers…

Purpose: This paper aims to introduce the extended qualitative content analysis (EQCA) method to integrate data-reducing and data-complicating research steps when conducting qualitative research on the United Nations and other international institutions. Design/methodology/approach: EQCA supplements the method of qualitative content analysis,…

This paper presents the Screencast-Based Assessment Technique (SBAT) for a mobile app development curriculum in the information systems discipline. SBAT was implemented as a midterm take-home exam in which students design and develop an app project based on their own interests, passions, or ambitions. In addition to coding, students must create…

This book has been prepared to introduce common technological tools that can be used in science education in the distance education process. Although most of the applications introduced in the book are used in face-to-face education, this book focuses on their use in the distance science education process. In the Introduction part of the book, the…

This paper provides a tutorial on epistemic network analysis (ENA), a novel method for identifying and quantifying connections among elements in coded data and representing them in dynamic network models. Such models illustrate the structure of connections and measure the strength of association among elements in a network, and they quantify…

Bias is part of the human condition and becoming aware of how to avoid bias will help to ensure greater accuracy in the work of assessment. In this paper the authors discuss three different theoretical frameworks that can be applied when assessing student work for cognitive skills such as critical thinking and problem solving. Each of the…

The multiple-choice question (MCQ) is the foundation of knowledge assessment in K-12, higher education, and standardized entrance exams (including the GRE, MCAT, and DAT). However, standard MCQ exams are limited with respect to the types of questions that can be asked when there are only five choices. MCQs offering additional choices more…

Visual word identification requires readers to code the identity and order of the letters in a word and match this code against previously learned codes. Current models of this lexical matching process posit context-specific letter codes in which letter representations are tied to either specific serial positions or specific local contexts (e.g.,…

Generally recognized as the standard work in its field, "Behavioral, Social, and Emotional Assessment of Children and Adolescents" provides a comprehensive foundation and guide for conducting conceptually sound, culturally responsive, and ecologically oriented assessments of student social and emotional behavior. It is aimed at graduate…

Despite a strong tradition of viewing "coded equivalence" as the underlying principle of linguistic semiotics, it lacks the power needed to understand and explain language as an empirical phenomenon characterized by complex dynamics. Applying the biology of cognition to the nature of the human cognitive/linguistic capacity as rooted in the…

A general inductive approach for analysis of qualitative evaluation data is described. The purposes for using an inductive approach are to (a) condense raw textual data into a brief, summary format; (b) establish clear links between the evaluation or research objectives and the summary findings derived from the raw data; and (c) develop a…