An increased focus on transparency and replication in science has stimulated reform in research practices and dissemination. As a result, the research culture is changing: the use of preregistration is on the rise, access to data and materials is increasing, and large-scale replication studies are more common. In this article, I discuss two…

This article describes the development and initial testing of the "Elementary Literacy Coach Self-Efficacy Survey", a new instrument designed and created to assess literacy coaches' efficacy for coaching-specific tasks. A synthesis of literature on literacy coaching tasks and experts in the coaching field were used to craft the…

The redesigned "TOEIC Bridge"® tests were designed to evaluate test takers' English listening, reading, speaking, and writing skills in the context of everyday adult life. In this paper, we summarize the initial validity argument that supports the use of test scores for the purpose of selection, placement, and evaluation of a test…

In Australia, one of the key findings of the Teacher Education Ministerial Advisory Group was that not all graduating pre-service teachers possess adequate pedagogical content knowledge (PCK) to teach effectively. The concern is that higher education providers working with pre-service teachers are using pedagogical practices and assessments which…

Socioscientific issues, issues that center on the intersection between scientific and social problems in real-world contexts, are valuable tools to use in science instruction due to their association with gains in scientific literacy, argumentation skills, and content knowledge. However, due to their complex nature, crafting instruction using…

As children are receiving cochlear implants at younger ages, benchmarks in speech, language, and auditory development can assist auditory-verbal therapists in setting expectation levels. Therapists can then counsel parents who often inquire how their children are progressing compared to peers with the same amount of listening experience. This…

One of the most critical steps in the test development process is defining the construct, or the knowledge, skills, or abilities, to be assessed. This foundational step provides the basis for initial assumptions about the meaning of test scores and serves as a reference for subsequent validity research. In this paper, we describe the purpose of…

American Educational Research Association (AERA) standards stipulate that researchers show evidence of the internal structure of instruments. Confirmatory factor analysis (CFA) is one structural equation modeling procedure designed to assess construct validity of assessments that has broad applicability for counselors interested in instrument…

Increasingly content area projects and programs at the K-12 level, such as in mathematics, involve a programmatic component or project emphasis on developing "teacher leadership". However, there is no consistent definition or framework for this construct and even fewer validated tools for measuring it. This paper describes our efforts in…

The C-Test as a tool for assessing language competence has been in existence for nearly 40 years, having been designed by Professors Klein-Braley and Raatz for implementation in German and English. Much research has been conducted over the ensuing years, particularly in regards to reliability and construct validity, for which it is reported to…

The purpose of this paper is to describe briefly the development and utility of the "Assessment of Reading Instructional Knowledge-Adults" ("ARIK-A"), the only nationally normed (n?=?468) measure of adult reading instructional knowledge, created to facilitate professional development of adult educators. Developmental data…

This paper developed a Democratic Classroom Survey to measure students' perceived democratic environment of the classroom. Perceived democratic environment is one of the most important variables for understanding classroom activity and indeed any type of group activity, but actually measuring perceptions in an objective manner has been…

In this article, we highlight the need for a precisely defined construct in score-based validation and discuss the contribution of cognitive theories to accurately and comprehensively defining the construct. We propose a framework for integrating cognitively based theoretical and empirical evidence to specify and evaluate the construct. We apply…

The PEDI-CAT is a new computer adaptive test (CAT) version of the Pediatric Evaluation of Disability Inventory (PEDI). Additional PEDI-CAT items specific to postacute pediatric hospital care were recently developed using expert reviews and cognitive interviewing techniques. Expert reviews established face and construct validity, providing positive…

Structured questionnaires and semi-structured interviews are often used in mixed method studies to generate confirmatory results despite differences in methods of data collection, analysis, and interpretation. A review of 19 questionnaire-interview comparison studies found that consensus and consistency statistics were generally weak between…