One of the most critical steps in the test development process is defining the construct, or the knowledge, skills, or abilities, to be assessed. This foundational step provides the basis for initial assumptions about the meaning of test scores and serves as a reference for subsequent validity research. In this paper, we describe the purpose of…

This study aims to conduct validity and reliability analysis of Organizational Structure Scale-University version (OSS-U) that enables us to determine organizational structures of universities. The scale was developed based on the Axiomatic Theory by Hage, literature review and expert opinions. The sample of the study consisted of a total of 655…

We used the Rule Space Model, a cognitive diagnostic model, to measure the learning progression for thermochemistry for senior high school students. We extracted five attributes and proposed their hierarchical relationships to model the construct of thermochemistry at four levels using a hypothesized learning progression. For this study, we…

After a brief review of the 4-H professional development standards, a new model for determining the value of continuing professional development is introduced and applied to the 4-H standards. The validity of the 4-H standards is affirmed. 4-H Extension professionals are encouraged to celebrate the strength of their standards and to engage the…

When seeking entry to a profession or employment in Ontario, Canada, internationally trained professionals may face multiple challenges. One of the most serious challenges to labour market success, as identified by immigrants themselves, is a lack of recognition of the academic credentials earned outside of Canada. International credential…

Work integrated learning (WIL) educators using reflective practice to facilitate student learning require a set of standards that works within the traditional assessment frame of Higher Education, to ascertain the level at which reflective practice has been demonstrated. However, there is a paucity of tested assessment instruments that provide…

Key challenges that confront the Information and Communication Technology (ICT) industry today in defining and achieving social, environmental, and economic sustainability goals include identifying sustainable operating standards and best practices and measuring and assessing performance against those practices. The industry lacks a framework for…

Interpretations for licensure tests involve a series of inferences or a validity argument, leading from the test score to decisions about who is accepted or denied entry into a profession. Utilizing an argument-based framework for validation based on the Standards for Educational and Psychological Testing, we explore the evidence for the ongoing…

The research purpose was to develop an evaluation model for the internal quality assurance system of the dramatic arts College of Bunditpattanasilpa Institute. The Research and Development method was used as research methodology which was divided into three phases; "developing the model and its guideline", "trying out the actual…

The Many-Facet Rasch (MFR) Model is traditionally used to evaluate the quality of ratings on constructed response assessments; however, it can also be used to evaluate the quality of judgments from panel-based standard setting procedures. The current study illustrates the use of the MFR Model by examining the quality of ratings obtained from a…

After a test is developed, most content validation analyses shift from ascertaining domain definition to studying domain representation and relevance because the domain is assumed to be set once a test exists. We present an approach that allows for the examination of alternative domain structures based on extant test items. In our example based on…

In this article, we present the background to the development of test reviewing by the British Psychological Society (BPS) in the United Kingdom. We also describe the role played by the BPS in the development of the EFPA test review model and its adaptation for use in test reviewing in the United Kingdom. We conclude with a discussion of lessons…

Across the nation, states and districts are in the process of building better teacher evaluation systems that not only identify highly effective teachers but also systematically provide data and feedback that can be used to improve teacher practice. The "Practical Guide to Designing Comprehensive Teacher Evaluation Systems" is a tool…

In the past decade, American professional psychology has taken significant steps toward a unified statement of the competencies that define the practice of psychology, regardless of specialty. The purpose of this article is to explain the current competency initiative in professional psychology and examine its implications and potential impact on…

The performing arts studio is a highly complex learning setting, and assessing student outcomes relative to reliable and valid standards has presented challenges to this teaching and learning method. Building from the general international higher education literature, this article illustrates details, processes, and solutions, drawing on…