A critical revisiting of research methods with multilingual learners raises issues of validity that are often unaddressed in current discussions of research quality. Though validity is conceptualized and assessed differently across research traditions, validity broadly describes the production of findings that are credible and trustworthy. The…

Dynamic assessments (DAs) of word reading skills demonstrate strong criterion reference validity with word reading measures (WRMs). However, DAs vary in the skills they assess, their format and administration method, and the type of words and symbols used in test items. These characteristics may have implications on assessment validity. To compare…

The main aim of our study was to adapt the Questionnaire on Teacher Interaction (QTI) to an Estonian context. The QTI was translated and evaluated by three educational researchers and validated with a sample of 508 students from grades 6 and 9 in 13 middle schools. When statistical analyses were utilized to investigate reliability and validity of…

This report investigates whether higher education systems across Europe recognise and validate learning outcomes from non-formal and informal learning. Specifically, the report looks at whether non-formal and informal learning can enable alternative access to higher education; the extent to which non-formal and informal learning can contribute to…

The implementation of Positive Behavioral Interventions and Supports (PBIS) has been attributed to a decrease in office discipline referrals (ODRs) and suspensions and to increase academic performance, and engagement, as well as staff, family, and student perceptions of a safe and positive school climate. High schools have had more significant…

We report findings from a longitudinal study of students' beliefs about empirical arguments and mathematical proof. We consider the influence of an 'Introduction to Proof (ITP)' course and the consequences of the observed changes in behaviour. Consistent with recent literature, our findings suggest that a majority of the thirty-eight undergraduate…

Quantitative measures of systematic differences in OSCE scoring across examiners (often termed examiner stringency) can threaten the validity of examination outcomes. Such effects are usually conceptualised and operationalised based solely on checklist/domain scores in a station, and global grades are not often used in this type of analysis. In…

In this paper, we explore measurements of design creativity through metrics related to the processes used in designing and relate them to the metrics used in psychology for idea creativity, ie, novelty and fluency. Our goal was to test the reliability of psychometric measures of creativity to assess creativity in team design. We studied 19 teams…

Given the lack of cultural consideration of studies on digital natives, this study reports on a large-scale validation of the Digital Native Assessment Scale (DNAS) among university students from three regions of Greater China: Chinese mainland, Macau, and Taiwan, to examine measurement invariance and latent mean differences in the four constructs…

Education researchers often encounter scenarios where an abrupt policy change occurs within or across jurisdictions or populations that affect key student outcomes. Difference-in-differences is a research design analysts can use to estimate causal effects of these "natural experiments." This article introduces education researchers to…

As evidence from evaluation and experimental studies continue to influence decision and policymaking, applied researchers and practitioners require tools to derive valid and credible inferences. Over the past several decades, research in causal inference has progressed with the development and application of propensity scores. Since their…

A mixed methods randomized control trial (RCT) was employed to investigate the social validity ratings (i.e., acceptability, appropriateness, and feasibility) of middle-school students using an innovative program of virtual social scenarios called VOISS (Virtual reality (VR) Opportunities to Integrate Social Skills) compared to an evidence-based,…

In this study, a valid and reliable scale (TSSSSS) was aimed to develop to measure secondary school students' perceptions of teacher support. The research was carried out on a total of 773 students studying in 6 different secondary schools in Ankara's Yenimahalle district in the Spring Term of the 2021-2022 Academic Year. The students who…

Universal screening to predict students' risk for reading problems is a foundational component of the Multi-Tiered Systems of Support framework and is required by law in many US states. School or district administrators are tasked with selecting screening assessments that are both technically adequate and feasible given the resources of their…

Despite agreement about the central importance of validity for educational and psychological testing, consensus regarding the definition of validity remains elusive. Differences in the definition of validity are examined and reveals that a potential cause of disagreement stems from differences in word use and meanings given to key terms commonly…