Recent methods have sought to improve precision in randomized controlled trials (RCTs) by utilizing data from large observational datasets for covariate adjustment. For example, consider an RCT aimed at evaluating a new algebra curriculum, in which a few dozen schools are randomly assigned to treatment (new curriculum) or control (standard…

Validity is one of the psychometric properties of the achievement tests. To determine the validity, one of the examination is item bias studies, which are based on differential item functioning (DIF) analyses and field experts' opinion. In this study, field experts were asked to estimate the DIF levels of the items to compare the estimations…

Key concerns about the psychometric properties of the 25-item version of the Strengths and Difficulties Questionnaire (SDQ) have consistently been raised in the literature. The present study aimed at examining the meaningfulness of an alternative model to the SDQ in which 7 problematic items are excluded. French-speaking parents of 262 boys and…

While problem solving as an instructional technique is widely advocated, educators are often challenged in effectively assessing student skill in this area. Students failing to solve a problem might fail in any of several aspects of the effort. The purpose of this research was to validate a scaffolded technique for assessing problem solving in…

The purposes of this study are to investigate whether pre-service middle school mathematics teachers evaluate discussions in the cases regarding proof by contradiction correctly, to what extent they explain their correct evaluations by referring to proof by contradiction, and the reasons of their misinterpretations of discussions in the cases…

Researchers have been keen to develop instruments for the assessment of teachers' self-perceived technological pedagogical content knowledge (TPACK); however, few studies have been conducted to validate such assessment tools through students' perspectives in the context of English as a foreign language (EFL). The purpose of this study was thus to…

Indonesia is a country that has abundant renewable energy sources, one of which is hydropower that can be utilized as an alternative energy source. However, fossil energy remains as major supplier of energy needs in all sectors of activity. The Education for Environmental Sustainable Development (EESD) approach can be applied in science education…

The proliferation of Internet usage has motivated Internet researchers and practitioners to study possible gratifications underlying Internet use. Despite the fact that research examining Internet gratification is more than two decades old, no attempt has been made in the last decade to develop an instrument that has known reliability of scores…

Validity and reliability are among the most crucial characteristics of a test. One of the steps to make sure that a test is valid and reliable is to examine the bias in test items. The purpose of this study was to examine the bias in 2012 Placement Test items in terms of gender variable using Rasch Model in Turkey. The sample of this study was…

K-12 intervention studies often include fidelity of implementation (FOI) as a mediating variable, though most do not report the validity of fidelity measures. This article discusses the critical need for validated FOI scales. To illustrate our point, we describe the development and validation of the Implementation Validity Checklist (IVC-R), an…

The current study reports the results of a project aimed at assessing L2 listening comprehension by drawing on two approaches to dynamic assessment: interventionist and interactionist. The former approach was actualized by providing two graduated hints which were fixed and standardized for all test takers while the latter was actualized by asking…

In response to a request for additional analyses, in particular reporting confidence intervals around the results, we re-analyzed the data from prior studies. This supplementary report presents the results of the additional analyses addressing classification accuracy, reliability, and criterion-related validity evidence. For ease of reference, we…

The numerous advantages of structural equation modeling (SEM) for the analysis of multitrait-multimethod (MTMM) data are well known. MTMM-SEMs allow researchers to explicitly model the measurement error, to examine the true convergent and discriminant validity of the given measures, and to relate external variables to the latent trait as well as…

This study used exploratory factor analysis to test the factor structure of the Project for Educational Research That Scales (PERTS) instrument. Research that reports the reliability, construct validity, and factor structure of the PERTS scale is useful for interpreting the results from the use of the widely distributed survey and for suggesting…

In response to a request for additional analyses, in particular reporting confidence intervals around the results, we re-analyzed the data from prior studies. This supplementary report presents the results of the additional analyses addressing classification accuracy, reliability, and criterion-related validity evidence. For ease of reference, we…