Automatic item generation may supply many items instantly and efficiently to assessment and learning environments. Yet, the evaluation of item quality persists to be a bottleneck for deploying generated items in learning and assessment settings. In this study, we investigated the utility of using large-language models, specifically Llama 3-8B, for…

These guidelines describe considerations relevant to the assessment of test takers in or across countries or regions that are linguistically or culturally diverse. The guidelines were developed by a committee of experts to help inform test developers, psychometricians, test users, and test administrators about fairness issues in support of the…

Background: Care and service trajectories for people with intellectual disabilities are routes within the health care delivery system that consist of all the steps that people with intellectual disability and their families have to take in order to realize needed care and services. In contrast to the growing body of system-orientated knowledge…

Research Findings: An effective quality rating system will lead to quality assurance and improvement of early childhood education programs. Many studies have been conducted to examine the validity of quality rating instruments in Western countries, but few have been done in China. The present study investigated the effectiveness of the Beijing…

Background: There is an absence of research concerning the assessment of housing support worker job performance, particularly in the development of job performance measures that reflect the priorities of people with intellectual disabilities and their families. Method: A worker-oriented job analysis method was used to develop four short job…

This paper reports on the development of a scale for determining the quality of the student e-learning experience at the degree level when the student learning context is predominately a campus-based experience. Rapid developments in the use of information and communication technologies (ICT) in higher education require methods for evaluating the…

Purpose: Student evaluation of teaching (SET) questionnaires are used in many countries, although much current research questions the validity of these surveys. US research indicates that more than 90 percent of academic accounting departments use this performance measurement. This paper aims to focus on the validity of SET data.…

This paper reviews the literature on consumer involvement in dental quality assessment, argues for inclusion of this information in quality assessment measures, outlines a conceptual model for measuring dental consumer quality assessment, and presents data relating to the development and validation of an instrument based on the conceptual model.…

This pilot study introduces a scale to assess structural knowledge in concept maps. The need to increase our understanding of structural knowledge through improved assessment is made evident in a review of research that indicates that its quality is related to problem-solving abilities. The new scale is derived from Biggs and Collis' (1982)…

Quality measures were originally developed for research aimed at describing the settings that children spend time in and identifying the characteristics of these environments that contribute to children's development. They were also developed to guide improvements in practice. Increasingly, however, measures of quality are being used for further…

Drawing on the experience of Oregon's new-teacher evaluation system, describes teacher work-sample methodology and evidence for its reliability and validity in evaluating the performance of prospective teachers. This is a methodology that responds to the challenge issued by the National Commission on Teaching and the America's Future challenge.…

The most fundamental technical quality issue raised by proposals for a national examination system is that of validity. Types of evidence needed to judge the validity of test use and the interpretation of results are discussed, and examination content, fairness, impact, generalizability, and comparability are explored. (SLD)

Two separate sets of minimum standards designed to guide the evaluation of bilingual projects are proposed. The first set relates to the process in which the evaluation activities are conducted. They include: validity of assessment procedures, validity and reliability of evaluation instruments, representativeness of findings, use of procedures for…

THE NEED FOR A QUALITY CONTROL SYSTEM IN A MILITARY TRAINING PROGRAM AND THE METHODS OF ESTABLISHING SUCH A UNIT ARE DESCRIBED AND EVALUATED IN THIS REPORT. THE PURPOSE OF QUALITY CONTROL IS TO INSURE A SATISFACTORY STANDARD OF COMPETENCE AMONG THE STUDENTS WHO GRADUATE, TO MAINTAIN THIS QUALITY BY A CONTINUOUS MONITORING PROCESS, AND TO IMPROVE…

This study attempted to develop a reliable and valid instrument for assessing work environment and continuous quality improvement efforts in the non-academic sectors of colleges and universities particularly those institutions who have adopted Total Quality Management programs. A model of a work environment for continuous quality improvement was…