This paper reviews the International English Language Testing System's speaking sub-test in the East Asia region with reference to theoretical and practice-based perspectives and identifies future research opportunities to enhance the measures of test qualities found. The test's construct validity was seen to accurately measure the abilities…

The Scylla and Charybdis in this discussion of teacher evaluation are standardized achievement test data on the one hand, and classroom observational systems on the other. These are the two most common methods used to judge teachers' competency. Both have serious flaws: the former primarily with validity, the latter primarily with reliability. At…

This article calls into question the use of the h-index as an aid to decision-making in the higher education sector. The h-index is increasingly employed by institutions, funding bodies and even governments as a guide to the allocation of resources. This practice is contrary to the evidence that the h-index is intrinsically meaningless, a point…

Claims of changes in the validity coefficients associated with general mental ability (GMA) tests due to the passage of time (i.e., temporal validity degradation) have been the focus of an on-going debate in applied psychology. To evaluate whether and, if so, under what conditions this degradation may occur, we integrate evidence from multiple…

Oral language skills are important to consider in school psychology practice, as they are directly tied to many areas of academic functioning. For example, research has demonstrated that oral language skills in early elementary school predict reading comprehension in later grades (Kendeou, van den Broek, White, & Lynch, 2009). With a…

Students with positive attitudes toward statistics are likely to show strong academic performance in statistics courses. Multiple surveys measuring students' attitudes toward statistics exist; however, a comparison of the validity and reliability of interpretations based on their scores is needed. A systematic review of relevant electronic…

Despite advances in child maltreatment research, accurate measurement of exposure remains a key issue. In this study, we evaluated a short form (CEVQ-SF) of the Childhood Experiences of Violence Questionnaire (CEVQ) in a sample of adolescents involved with child protection services in an urban city in Ontario, Canada. Focusing on the two most…

In this paper, the author aims to provide novice researchers with an understanding of the general problem of validity in social science research and to acquaint them with approaches to developing strong support for the validity of their research. She provides insight into these two important concepts, namely (1) validity; and (2) reliability, and…

Context: Instrument validation is an important facet of survey research methods and athletic trainers must be aware of the important underlying principles. Objective: To discuss the process of survey development and validation, specifically the process of construct validation. Background: Athletic training researchers frequently employ the use of…

Based on the results of a prior case-study analysis of mathematics placement at one university, the mathematics department developed and piloted a mathematics placement test. This article describes the implementation process for a mathematics placement test and further analyzes the test results for the pilot group. As an unexpected result, the…

One leading version of hope theory posits hope to be a general disposition for goal-directed agency and pathways thinking. Domain-specific hope theory suggests that hope operates within context and measures of hope should reflect that context. This study examined three measures of hope to test the predictive, construct, and convergent validity…

The National Survey of Student Engagement (NSSE) Benchmarks has emerged as a competing paradigm for assessing institutional effectiveness vis-a-vis the U.S. News & World Report. However, Porter (2009) has critiqued it for failing to meet validity and reliability standards. This study investigated whether the NSSE five benchmarks had construct…

Impairment in the development of reciprocal social interaction and other social skills is one of the defining characteristics of Autism Spectrum Disorders (ASD). There is a need for assessment tools that will help guide social skills interventions and document outcomes. The purpose of this study was to examine the potential usefulness of two…

The authors report a series of efforts to validate a U.S. adult social self-efficacy inventory, the Perceived Social Self-Efficacy scale (PSSE), in Chinese populations. They argue that the construct underlying the PSSE scale constitutes an important component of Chinese adult social self-efficacy, which was confirmed in focus group discussions.…

Objective: This study examined test-retest reliability, internal consistency, and construct and predictive validity of the Physical Activity and Nutrition Self-Efficacy (PANSE) scale, an 11-item instrument to assess weight-loss self-efficacy among postpartum women of lower income. Methods: Seventy-one women completed the PANSE scale and…