Most existing solutions to the current replication crisis in science address only the factors stemming from specific poor research practices. We introduce a novel mechanism that leverages the experts' predictive abilities to analyze the root causes of replication failures. It is backed by the principle that the most accurate predictor is the most…

Technical documentation for educational tests focuses primarily on properties of individual scores at single points in time. Reliability, standard errors of measurement, item parameter estimates, fit statistics, and linking constants are standard technical features that external stakeholders use to evaluate items and individual scale scores.…

Recommendations from multiple professional organizations (e.g., American Psychological Association, Council for Exceptional Children, National Association of School Psychologists) suggest that collection of data on the social validity in practice and research is necessary. The purpose of this study was to systematically review the inclusion of…

Digital literacy is essential for scientific literacy in a digital world. Although the NGSS Practices include many activities that require digital literacy, most studies have examined digital literacy from a generic perspective rather than a curricular context. This study aimed to develop a self-report tool to measure elements of digital literacy…

The purpose of this study is to investigate association of data collectors' differences with the differences in reliability and validity of scores regarding affective variables (motivation toward science learning and science attitude) that are measured by Likert-type scales. Four researchers trained in data collection and seven science teachers…

This research focuses on ePortfolio assessment strategies that yield important accountability and reporting information. Under foundational categories of reliability, validity, and fairness, we present methods of gathering evidence from ePortfolio scores and their relationship to demographic information (gender, race/ethnicity, and socio-economic…

Out-of-school time (OST) youth programs are inherently difficult to assess. They are often very dynamic: Many youth interact with one another and with staff members in various physical environments. Despite the challenge, measuring quality is critical to help program directors and policy makers identify where to improve and how to support those…

The purpose of the research paper was to investigate the effect of eclectic learning approach on the academic achievement and retention of students in English at elementary level. A sample of forty students of 8th grade randomly selected from Government Boys High School Khurram District Karak was used. It was an experimental study and that's why…

This manual provides guidance and documentation for users of the longitudinal kindergarten-fourth grade (K-4) data file of the Early Childhood Longitudinal Study, Kindergarten Class of 2010-11 (ECLS-K:2011). It mainly provides information specific to the fourth-grade round of data collection. The first chapter provides an overview of the…

This research aims to produce mathematics problems based on PISA level with valid and practical content of change and relationships and has potential effect for Junior High School students. A development research method developed by Akker, Gravemeijer, McKenney and Nieveen is used this research. This development research consists of three stages;…

The Kindergarten Early Learning Scale (KELS) was developed as a concise observational assessment for young children. It examines three domains including (1) Math/Science, (2) Social Emotional/Social Studies, and (3) Language and Literacy, with a total of 10 items across the domains. Scores reported for each of the 10 items are based upon…

Because it is often impractical or impossible to obtain school transcripts or records on subjects, many researchers rely on college students to accurately self-report their academic record as part of their data collection procedures. The purpose of this study is to investigate the validity and reliability of student self-reported academic…

This study examined the predictive validity of pre-university examinations test scores (university matriculation examination (UME), Post-UME and pre-degree) for undergraduate academic achievement. The study is planned along the lines of correlational and ex-post-facto research design. A sample of four hundred university science based…

This article has three goals. The first goal is to clarify the role that the consequences of test score use play in validity judgments by reviewing the role that modern writers on validity have ascribed for consequences in supporting validity judgments. The second goal is to summarize current views on who is responsible for collecting evidence of…

Districts now have access to a wealth of new information that can help target students with appropriate supports and bring focus and coherence to college readiness efforts. However, the abundance of data has brought its own challenges. Schools and school systems are often overwhelmed with the amount of data available. The capacity of districts to…