One of the issues that hinder the students' learning progress is the inability to construct an epistemological explanation of a scientific phenomenon. Four-tier multiple-choice (hereinafter, 4TMC) instrument and Partial-Credit Model were employed to elaborate on the diagnosis process of the aforementioned problem. This study was to develop and…

We describe the summative assessment component within a K-12 assessment program and our development of a validity argument to support its claims with respect to intended uses and interpretations. First, we describe the "Winsight"® assessment program theory of action, a logic model elucidating mechanisms for how use of the assessment…

The purpose of this paper is to provide a proof of concept of a collaborative peer-, self- and lecturer assessment processes. The research presented here is part of an ongoing study on self- and peer assessments in higher education. The authentic assessment for sustainable learning (AASL) model is evaluated in terms of the correlations between…

This article exemplifies how assessment design might be grounded in theory, thereby helping to strengthen validity claims. Spanning work across multiple related projects, the article first briefly summarizes an assessment system model for the elementary and secondary levels. Next the article describes how cognitive-domain theory and principles are…

In the past decade, American professional psychology has taken significant steps toward a unified statement of the competencies that define the practice of psychology, regardless of specialty. The purpose of this article is to explain the current competency initiative in professional psychology and examine its implications and potential impact on…

Significant momentum exists for next-generation assessments to increasingly utilize technology to develop and deliver performance-based assessments. Many traditional challenges with this assessment approach still apply, including psychometric concerns related to performance-based tasks (PBTs), which include low reliability, efficiency of…

The performing arts studio is a highly complex learning setting, and assessing student outcomes relative to reliable and valid standards has presented challenges to this teaching and learning method. Building from the general international higher education literature, this article illustrates details, processes, and solutions, drawing on…

Recent advances in educational assessment, cognitive science, and artificial intelligence have made it possible to integrate valid assessment and instruction in the form of modern computer-based intelligent systems. These intelligent systems leverage assessment information that is gathered from various sources (e.g., summative and formative). This…

This paper describes how a naturalistic inquirer can demonstrate rigor, or trustworthiness, and how an auditor might assess it. Looking at both inquiry products and processes, Part 1 of this paper describes how an audit may assess whether an inquiry's findings and conclusions are grounded in the raw data, and whether appropriate conventions were…

Selected aspects of the problem of obtaining unbiased program or product evaluation are discussed. An evaluator who is a member of the project staff will have difficulty producing an evaluation which is credible and valid. Project monitors will also have a problem since they are often required to assume the conflicting roles of external evaluator…

The overall poor quality of educational software on the market suggests that educators must continue efforts to evaluate available packages and to disseminate their findings. In this paper, weaknesses in published evaluation procedures are identified, and an alternative model, the York Educational Software Evaluation Scale (YESES), is described.…

Current curriculum evaluation models tend to cater to desirable or ideal situations and offer little help to the evaluator of ongoing curricular innovations, many of which are characterized by little assistance or control of implementation, little monitoring or supervision of operation, and haphazard postimplementation modification or development.…

The literature on validity provides much more guidance on how to collect various kinds of validity evidence than it does on which kinds of evidence to collect in specific cases. An argument-based approach to validation redresses the balance by linking the kinds of evidence needed to validate a test-score interpretation to the details of the…

The differentiated outcome hypothesis posits that the maximum effects of an educational program are realized along those dimensions emphasized in the program or in those central to the persons involved. The idea that educational programs employing unconventional means should be examined on outcomes that are consistent with those means is derived…

Validation in curriculum development is the "check-and-balance" dimension of any instructional system, in the broadest sense almost synonymous with evaluation and accountability. This paper relates validation to individual, formative, and summative evaluation. Validation measures to be applied to instructional systems are outlined according to a…