This study analyzed data from four evaluation designs incorporating the retrospective pretest (i.e., thentest), analyzing the effects of self-report pretesting and post-program survey format on a set of self-report measures. Validity of self-report data was assessed by comparing the criterion validity of then ratings to established benchmarks and…

The study investigates empirical properties of reasoning speed which is conceived as the fluency of solving reasoning problems. Responses and response times in reasoning tasks are modeled jointly to clarify the covariance structure of reasoning speed and reasoning ability. To determine underlying abilities, the predictive validities of two…

This study reports findings from a validation study of the Student Risk Screening Scale for use with 9th- through 12th-grade students (N = 1854) attending a rural fringe school. Results indicated high internal consistency, test-retest stability, and inter-rater reliability. Predictive validity was established across two academic years, with Spring…

The purpose of this study was to examine the validity evidence of first-grade Dynamic Indicators of Basic Early Literacy Skills (DIBELS) scores for predicting third-grade reading comprehension scores. We used the "simple view" of reading as the theoretical foundation for examining the extent to which DIBELS subtest scores predict…

The purpose of this study was twofold. First, the utility of the Integrative Contextual Model of Career Development (ICM) to describe the career development behavior of college students was examined. Second, relationships among educational and career development skills (career exploration, person-environment fit, goal setting,…

Students tend to believe that RateMyProfessors.com (RMP) is an unfailingly valid measure of teaching effectiveness, and in fact viewing that site prior to taking a course can have a direct influence on their future evaluations of faculty. The authors describe an activity whose objective is to have students analyze different types of validity using…

This mixed methods study explored the nature of a benchmark assessment program and how well the benchmark assessments predicted End-of-Grade (EOG) and End-of-Course (EOC) test scores in an American Indian school district. Five major themes were identified and used to develop a Dimensions of Benchmark Assessment Program Effectiveness model:…

The interpretation of subtest profiles from intelligence testing remains popular among many practitioners who use subtest performance to draw diagnostic conclusions, in spite of criticism by some researchers, who point to the low reliability and predictive validity of subtest scores in predicting achievement outcomes. Prior research outlines two…

In February of 2013, the College Board announced it would undertake a redesign of the SAT® in order to develop an assessment that better reflects the work that students will do in college, focusing on the core knowledge and skills that evidence has shown to be critical in preparation for college and career. The redesigned test will be introduced…

This report analyzes construct and predictive validity of a Social and Emotional Learning (SEL) Competency Survey. Students' SEL skill ratings were correlated with other measures of SEL skills and other outcomes of interest. Separate research brief and executive summary were published. [For the Research Brief, see ED626925. For the Executive…

This article sets out to examine the relationship between EFL learners' goal orientation, metacognitive awareness and self-efficacy in a single framework. One hundred fifteen EFL students from two universities of Mashhad, a city in north-eastern Iran took part in this study. Structural equation modeling (SEM) was utilized to examine the…

Purpose: We explore whether certain employer characteristics predict Americans with Disabilities Act (ADA) charges and whether the same characteristics predict receipt of the Age Discrimination in Employment Act and Title VII of the Civil Rights Act charges. Method: We estimate a set of multivariate regressions using the ordinary least squares…

This study examined the use of measures of student learning computed using end-of-year assessments (distal measures) versus measures of student learning associated with a single lesson (proximal measures) as criterion scores for the validity of observations of teachers' pedagogical skills. The validity coefficients computed using distal…

Assessment is at the center of a decision-making model within a Response to Intervention (RTI) framework. Assessments that can be used for universal screening and progress monitoring in early childhood RTI models are needed that are both psychometrically sound and appropriate to meet developmental needs of young children. The Preschool Early…

The Study evaluated the predictive validity of various operationalizations of AP® Exam and course information that could be used to make college admission decisions. The incremental validity of different AP variables, above and beyond traditional admission measures such as SAT® and high school grade point average (HSGPA), in predicting first-year…