Scale validation is vital to psychological research because it ensures that scores from measurement scales represent the intended construct. Factor analysis fit indices are commonly used to provide quantitative evidence that a proposed factor structure is plausible. However, there is mismatch between guidelines for evaluating fit of factor models…

Background and Context: Despite the increasing implementation of coding in early curricula, there are few valid and reliable assessments of coding abilities for young children. This impedes studying learning outcomes and the development and evaluation of curricula. Objective: Developing and validating a new instrument for assessing young…

There is an increased demand on nursing faculty to provide quality teaching and assessment. Nursing faculty are required to ensure accurate assessment of learning through testing and outcome measurement that are critical elements of the evaluation process. Likewise, nursing faculty should implement a logical evaluation system. However, the…

Prompted by Taiwanese university students' increasing demand for English proficiency assessment, the absence of a test designed specifically for this demographic subgroup, and the lack of a localized and freely-accessible proficiency measure, this project set out to develop and validate a computerized adaptive English proficiency testing (E-CAT)…

Purpose: Identifying appropriate targets for vocabulary instruction and determining the optimal sequence for instruction continue to be a challenge. The purpose of this study is to investigate how previously studied lexical characteristics collectively influence children's word learning. Method: A secondary data analysis was conducted using the…

Purpose: Identifying appropriate targets for vocabulary instruction and determining the optimal sequence for instruction continue to be a challenge. The purpose of this study is to investigate how previously studied lexical characteristics collectively influence children's word learning. Method: A secondary data analysis was conducted using the…

This mixed methods study examined holistic, analytic, and part marking models (MMs) in terms of their measurement properties and impact on candidate CEFR classifications in a semi-direct online speaking test. Speaking performances of 240 candidates were first marked holistically and by part (phase 1). On the basis of phase 1 findings--which…

Standard setting is the process of identifying the point(s) on a scale that serve to differentiate between individuals of distinct proficiency levels. While standard setting is ultimately a policy decision, most of the process is carried out by subject matter experts who are tasked with reconciling item-level or examinee-level information (e.g.…

In recent years, approaches to developing teacher competency in technology integration have moved away from an over emphasis on technological knowledge, to focus on the essential connections between technology, pedagogy and content knowledge (TPACK) (Chai, Koh, & Tsai, 2013a; Harris, Mishra, & Koehler, 2009; Mishra & Koehler, 2006). A…

One of the most critical steps in the test development process is defining the construct, or the knowledge, skills, or abilities, to be assessed. This foundational step provides the basis for initial assumptions about the meaning of test scores and serves as a reference for subsequent validity research. In this paper, we describe the purpose of…

It is often a challenge for adolescents with autism spectrum disorder (ASD), as it is for many individuals with disabilities, to participate in activities such as physical education class or community sports with typically developing peers. As such, activities that do not require high skill levels and team environments have been recommended for…

The past decade has seen an emerging interest in mapping (aligning or linking) test scores to language proficiency levels of external performance scales or frameworks, such as the Common European Framework of Reference (CEFR), as well as locally developed frameworks, such as China's Standards of English Language Ability (CSE). Such alignment is…

Most language proficiency exams in Europe are presently developed so that reported scores can be related to the "Common European Framework of Reference for Languages" (CEFR; (Council of Europe. 2001. "Common European framework of reference for languages: learning, teaching, assessment." Cambridge: Cambridge University Press.).…

Background: Concept inventories (CIs) are commonly used in engineering disciplines to assess students' conceptual understanding and to evaluate instruction, but educators often use CIs without sufficient evidence that a structured approach has been applied to validate inferences about student thinking. Purpose: We propose an analytic framework for…

Background: The present study examined the validity of a university-based speaking assessment (Test of Oral Proficiency in English, TOPE for short) in mainland China. The speaking assessment was developed to meet the standards (Standard for Oral Proficiency in English, SOPE for short) set for teaching and learning of the oral English by the…