Assessment literacy is an essential competency area for professional counselors who administer tests and interpret the results of participants' scores. Using factor analysis to demonstrate internal structure validity of test scores is a key element of assessment literacy. The underuse of psychometrically sound instrumentation in professional…

American Educational Research Association (AERA) standards stipulate that researchers show evidence of the internal structure of instruments. Confirmatory factor analysis (CFA) is one structural equation modeling procedure designed to assess construct validity of assessments that has broad applicability for counselors interested in instrument…

Increasingly content area projects and programs at the K-12 level, such as in mathematics, involve a programmatic component or project emphasis on developing "teacher leadership". However, there is no consistent definition or framework for this construct and even fewer validated tools for measuring it. This paper describes our efforts in…

The main problem of the educational evaluation validity is that it just copies the conceptual framework system of validity from educational measurement to its own conceptual system. The validity conceptual system that fits the need of theory and practice of educational evaluation has not been established yet. According to the inherent attributive…

This commentary on the article titled "Examining the Internal Structure Evidence for the Performance Assessment for California Teachers: A Validation Study of the Elementary Literacy Teaching Event for Tier 1 Teacher Licensure" provides an overview of Performance Assessment for California Teachers (PACT), its relationship to edTPA and…

In Gargani and Strong (2014), we describe The Rapid Assessment of Teacher Effectiveness (RATE), a new teacher evaluation instrument. Our account of the validation research associated with RATE inspired a review by Good and Lavigne (2015). Here, we reply to the main points of their review. We elaborate on the validity, reliability, theoretical…

The argument-based approach to validation involves two steps; specification of the proposed interpretations and uses of the test scores as an interpretive argument, and the evaluation of the plausibility of the proposed interpretive argument. More ambitious interpretations and uses tend to involve an extended network of inferences and assumptions…

The Career Adapt-Abilities Scale--South African Form (CAAS) consists of four scales, each with six items that measure concern, control, curiosity, and confidence as psychosocial resources for managing occupational transitions, developmental tasks and work traumas. Internal consistency estimates for the subscale and total scores ranged from good to…

The purpose of this paper is to describe briefly the development and utility of the "Assessment of Reading Instructional Knowledge-Adults" ("ARIK-A"), the only nationally normed (n?=?468) measure of adult reading instructional knowledge, created to facilitate professional development of adult educators. Developmental data…

In this article, we highlight the need for a precisely defined construct in score-based validation and discuss the contribution of cognitive theories to accurately and comprehensively defining the construct. We propose a framework for integrating cognitively based theoretical and empirical evidence to specify and evaluate the construct. We apply…

Research supports the connection between engagement, achievement, and school behavior across levels of economic and social advantage and disadvantage. Despite increasing interest and scientific findings, a number of interrelated conceptual and methodological issues must be addressed to advance this construct, particularly for designing…

The assessment of students is used for various different purposes within an assessment system. It has an impact on students, teaching and the curriculum, the nature of this impact depending upon how it is carried out. In order to evaluate the advantages and disadvantages of particular assessment procedures, criteria need to be applied. This…

This article describes the development and two studies on the construct validity of the Academic Emotions Scale (AES). The AES is a French self-report questionnaire assessing six emotions in the context of school learning: enjoyment, hope, pride, anxiety, shame and frustration. Its construct validity was studied through exploratory and…

This handbook is designed as a quick reference for first-year teachers who find themselves in an assessment driven environment with little experience to help make sense of the language, underlying philosophy, or organizational structure of the assessment system. The handbook begins with advice on developing and evaluating effective learning…

The Philosophies Held by Instructors of Lifelong-learners (PHIL) was developed to identify a respondent's preference for one of the major schools of philosophical thought: Idealism, Realism, Pragmatism, Existentialism, or Reconstructionism. Using the pool of items from an established instrument, its final form and content validity were determined…