Background: For decades, education researchers have relied on the work of Campbell, Cook, and Shadish to help guide their thinking about valid impact estimates in the social sciences (Campbell & Stanley, 1963; Shadish et al., 2002). The foundation of this work is the "validity typology" and its associated "threats to…

In this study, researchers compared the concordance of teacher-level effectiveness ratings derived via six common generalized value-added model (VAM) approaches including a (1) student growth percentile (SGP) model, (2) value-added linear regression model (VALRM), (3) value-added hierarchical linear model (VAHLM), (4) simple difference (gain)…

Despite the critical role of emotions in multicultural teacher education, no attempt has been made to develop an instrument including affect as a dimension in measuring cultural competence for preservice teachers. To bridge this gap, the present three-study research used three distinct samples of 456 preservice teachers to develop and estimate the…

We constructed a new taxonomy for inferential thinking, a construct called Integrative Inferential Reasoning (IIR). IIR extends Pearson and Johnson's (1978) framework of "text-implicit" and "script-implicit" question-answer relations, and integrates several other prominent literacy theories to form a unified inferential…

Critical thinking has been one of the 21st-century skills consistently associated with students' future career advancement as a positive student outcome of STEM education. The aim of the study is to develop and validate science critical thinking skill instruments to assess the improvement in the subject of living organisms and force and friction…

Success in language learning has generally been attributed to students' motivation. However, beyond motivation is grit, a psychological construct that has rarely been mentioned in language learning research. This study therefore aimed to investigate the grit of 171 Thai students studying English as a Foreign Language (EFL), and the factors that…

The purpose of the study was to examine and compare the occupational stress of male and female secondary school heads in Khyber Pakhtunkhwa. All the male and female secondary school heads working in pubic secondary schools of Khyber Pakhtunkhwa constituted the population of the study. A total of 402 secondary school heads were selected as sample…

To validate an interpretation or use of test scores is to evaluate the plausibility of the claims based on the scores. An argument-based approach to validation suggests that the claims based on the test scores be outlined as an argument that specifies the inferences and supporting assumptions needed to get from test responses to score-based…

Background: Concept inventories (CIs) are commonly used in engineering disciplines to assess students' conceptual understanding and to evaluate instruction, but educators often use CIs without sufficient evidence that a structured approach has been applied to validate inferences about student thinking. Purpose: We propose an analytic framework for…

As educational practitioners and policymakers expand the range of student outcomes they assess, student perception surveys--particularly those targeting social-emotional learning--have grown in popularity. Despite excitement around the potential for measuring a wider array of important student outcomes, concerns about the validity of the…

This study compared models of assessment structure for achieving differentiation across the range of examinee attainment in the General Certificate of Secondary Education (GCSE) examination taken by 16-year-olds in England. The focus was on the "adjacent levels" model, where papers are targeted at three specific non-overlapping ranges of…

This study investigated the levels of possession of science process skills by final year Nigerian Certificate in Education (NCE) Students in colleges of Education in South-Eastern States of Nigeria. The skills that were assessed were observation, experimentation, measurement, communication, and inference. The research was guided by five research…

The purpose of this study is to investigate the causal relationship between global experience and global competency from a transformative learning theory perspective. China society is becoming more and more linguistically and culturally diverse in a global context. Moreover, Chinese students should be knowledgeable about the international issues…

Policymakers and school administrators have embraced value-added models of teacher effectiveness as tools for educational improvement. Teacher value-added estimates may be viewed as complicated scores of a certain kind. This suggests using a test validation model to examine their reliability and validity. Validation begins with an interpretive…

Data collection can be the most time- and cost-intensive part of developmental research. This article describes some long-proposed but little-used research designs that have the potential to maximize data quality (reliability and validity) while minimizing research cost. In "planned missing data designs", missing data are used…