This research investigates the effects of rater experience on performance ratings in language testing using a systematic review of studies published from 1985 to 2017. Based on a comprehensive literature search of 14 databases, we identified sixteen relevant papers. With these we conducted a narrative review to conceptualize a theoretical…

This article explores approaches to assessment of competence against nationally recognized units of competency and considers these approaches with regard to the intent of the underpinning units of competency and the notion of compliance with the Standards for Registered Training Organizations (RTOs) 2015, in particular Clause 1.8. Specifically,…

This study explores different conceptualizations of creativity within an educational setting, using textual coding and network mapping on data from a creativity-focused course. Two primary conceptualizations emerged: the Freedom-Possession and Playful-Adaptation conceptualizations. Each was associated with unique practices and elements of the…

Technological advancements, particularly in artificial intelligence, significantly transform our society and work practices. Computational thinking (CT) has emerged as a crucial 21st-century skill, enabling individuals to solve problems more effectively through an automation-oriented perspective and fundamental concepts of computer science. To…

As in many industrialized countries, Japan carried out a deregulation of higher education around the turn of the 21st century. This reform was based on New Public Management (NPM) principles, which should have been reflected in its most salient step: the incorporation of national universities in 2004. Although the way that the NPM principles were…

In the last twenty-five years, the discussion surrounding validity evidence has shifted both in language and scope, from the work of Messick and Kane to the updated Standards for Educational and Psychological Testing. However, these discussions haven't necessarily focused on best practices for different types of instruments or assessments, taking…

Block-based visual programming environments are increasingly used to introduce computing concepts to beginners. Given that programming tasks are open-ended and conceptual, novice students often struggle when learning in these environments. AI-driven programming tutors hold great promise in automatically assisting struggling students, and need…

Simulated testing has become more prevalent in higher education, especially as competency-based institutions begin to incorporate micro-credentials and skills certificates into their curriculum. Competency-based assessment falls outside traditional norm-based testing practices used in K-12 education, and is largely focused on criterion referenced…

Many national science frameworks (e.g., Next Generation Science Standards) argue that developing mathematical modeling competencies is critical for students' deep understanding of science. However, science teachers may be unprepared to assess these competencies. We are addressing this need by developing virtual lab performance assessments that…

Internship courses are an active and applied opportunity to integrate educational learning programs and courses within practice settings. Individual learners in internship courses have different work internship placements and they start a unique professional and practice journey. How can this authentic learning environment be supported with…

Portfolio assessment of teaching practice has been used in many states as one indicator to inform licensure decisions, yet the human scoring process is costly for all stakeholders. This paper documents a series of investigations of alternative scoring procedures for a state pre-service teacher performance assessment. The proposed partial double…

The Council for the Accreditation of Educator Preparation Programs (CAEP), required evidence of reliability and validity of measures used in a university's Educator Preparation Program (EPP). This paper describes processes that provided this evidence for the Teacher Performance Assessment (TPA). Literature examined included Messick (1989), Linn…

Problem-based Learning (PBL) has long been touted as an effective pedagogical approach in higher education to promote students' authentic learning. As a learner-centered pedagogy, PBL is characterized by students working collaboratively in small groups to solve messy, ill-structured problems that mirror real-world problems encountered by expert…

The impetus for test-based accountability systems is to improve the educational opportunities afforded to all students so as to improve their learning; therefore, integral to the validity argument of these systems is the appraisal of test-based inferences and decisions in terms of their consequences. Both positive and negative consequences of…

Human Resource Management (HRM) includes recruitment, training, development, motivation and evaluation of the staff who will achieve the goals of the organization and perform the necessary activities to be successful. The success of the organization depends on the effective use and management of human resources. Considering that The Ministry of…