Attention is brought to the existence of incongruity in the definition of reliability in the literature, and some unnecessary controversies and confusions which result. A conventionalization of the meaning of reliability at a conceptual, model-free level is proposed. Through the exploration of two paradoxes, this article attempts to address some…

An "Educational Researcher" article by Pamela Moss (1994) asks the title question, "Can there be validity without reliability?" Yes, she answers, if by reliability one means "consistency among independent observations intended as interchangeable" (Moss, 1994, p. 7), quantified by internal consistency indices such as…