Trend scoring constructed response items (i.e. rescoring Time A responses at Time B) gives rise to two-way data that follow a product multinomial distribution rather than the multinomial distribution that is usually assumed. Recent work has shown that the difference in sampling model can have profound negative effects on statistics usually used to…

In this paper I try to 'rethink' consistency as an educational quality for the 3rd millennium, following Italo Calvino's choice to take it up in his lecture series Memos for the Next Millennium, and despite the fact that the (final) lecture devoted to this quality remained unwritten. After reflecting on how consistency already plays a certain role…

Retrospective confidence refers to the phenomenological experience of the level of certainty that retrieved information is, in fact, correct. Retrospective confidence judgments are examined across a range of sub-disciplines in psychology from perception to memory research, and in education and legal applications. This paper focuses on…

This paper has two aims. One is to draw a distinction between two types of trust. The other is to argue for its applicability in academic discourse on educational policies. One of the two types of trust is "ethical trust" that rests on beliefs about others' ethical virtues. The other is "institutional trust" that typically…

Focusing on systematic observation, one of the most potent methods of studying teaching quality, represents one of the numerous contributions of Daryl Siedentop to the profession. While he had a clear focus on issues of validity and reliability concerning systematic observation, over the past decades, attention to such issues appears to have…

Higher education accreditation has spread internationally as a vehicle for quality assurance and improvement but is strongly influenced by accreditation practices in the United States. The organisational structure and processes of seven United States health professions accreditors were analysed to identify common characteristics that reflect…

This paper aims to explore the philosophical theoretical foundations of two basic research paradigms, namely positivism and interpretivism. In the discussion process, literature in the relevant fields including academic papers and books is reviewed and used as support for the analysis. Firstly, the paper explores the differences between the…

Context-aware mobile learning applications provide learning materials to suit the needs of individual learners. Despite several applications developed, there is a lack of architectural support for developing these applications. This has resulted in a number of challenges; lack of standardization, poor quality of developed applications, and…

How do we deal with unlikely witness testimonies? Whether in legal or everyday reasoning, corroborative evidence is generally considered a strong marker of support for the reported hypothesis. However, questions remain regarding how the prior probability, or base rate, of that hypothesis interacts with corroboration. Using a Bayesian network…

RobotReviewer is a tool for automatically assessing the risk of bias in randomized controlled trials, but there is limited evidence of its reliability. We evaluated the agreement between RobotReviewer and humans regarding the risk of bias assessment based on 1955 randomized controlled trials. The risk of bias in these trials was assessed via two…

This note is concerned with the benefits that can result from the use of the maximal reliability and optimal linear combination concepts in educational and psychological research. Within the widely used framework of unidimensional multi-component measuring instruments, it is demonstrated that the linear combination of their components that…

Visual data have dramatically increased in quantity in the digital age, presenting new opportunities for social science research. However, the extensive time and labor costs to process and analyze these data with existing approaches limit their use. Computer vision methods hold promise but often require large and nonexistent training data to…

Taking a sociological view, we can investigate the empirical consequences of variations in the rhetoric of sociological methodology. The standards advocated in Qualitative Literacy divide communities of qualitative researchers, as they are not explicitly connected to an understanding of social ontology, unlike previous qualitative methodologies;…

Citing practices have long been at the heart of scientific reporting, playing both socially and epistemically important functions in science. While such practices have been relatively stable over time, recent attempts to develop automated citation recommendation tools have the potential to drastically impact citing practices. We claim that, even…

Empirical researchers using qualitative comparative analysis (QCA) can work with crisp, multivalue, and fuzzy sets. The relative advantages of crisp and multivalue sets have been discussed in the QCA literature. There has been little reflection on the more frequent decision between crisp and fuzzy sets for which there often is no theoretical…