It is of critical importance to be aware of the historical discrimination embedded in the data and to consider a fairness measure to reduce bias throughout the predictive modeling pipeline. Given various notions of fairness defined in the literature, investigating the correlation and interaction among metrics is vital for addressing unfairness.…

Methods to generate random correlation matrices have been proposed in the literature, but very few instances exist where these correlation matrices are structured or where the statistical properties of the algorithms are known. By relying on the tetrad relation discovered by Spearman and the properties of the beta distribution, an algorithm is…

Ensuring that students are ready for college when they graduate from high school has important implications for students, educators, education policymakers, and other stakeholders. This study focuses on an examination of the relationship between the National Assessment of Educational Progress (NAEP) grade 12 mathematics assessment and college…

The amount of research evaluating the technical merits of general outcome measures of science and social studies achievement is growing. This study targeted criterion validity for critical content monitoring. Questions addressed the concurrent criterion validity of alternate presentation formats of critical content monitoring and the measure's…

This is a correlational study of two assessments used in education. The two assessments, Renaissance Learning's STAR Reading and Fountas and Pinnell's Benchmark Assessment System, were analyzed using data collected from third grade students to see if there was a significant correlation. The data collected was the scaled score from STAR Reading…

This study examined the relationship between two reading curriculum based measures (oral reading fluency and MAZE) and the reading and mathematics subsections of a high stakes test administered at the 5th and 6th grades. Bivariate correlations were conducted between each curriculum based measure and each subsection of the test. Results indicated…

The factorial survey is an experimental design consisting of varying situations (vignettes) that have to be judged by respondents. For more complex research questions, it quickly becomes impossible for an individual respondent to judge all vignettes. To overcome this problem, random designs are recommended most of the time, whereas quota designs…

This study analyzed the relationship between benchmark scores from two curriculum-based measurement probes in mathematics (M-CBM) and student performance on a state-mandated high-stakes test. Participants were 298 students enrolled in grades 7 and 8 in a rural southeastern school. Specifically, we calculated the criterion-related and predictive…

This study reports on an investigation of the predictive validity of the TOEFL iBT®test in an English-medium institution (EMI) in a non-target-language context, namely, Turkey. The relationship between TOEFL iBT scores and academic performance was explored in a cohort of 286 undergraduate students, as was the TOEFL iBT's relationship with an…

An online Moodle Workshop was evaluated for peer assessment effectiveness. A quasiexperiment was designed using a Seminar in Professionalism course taught in face-to-face mode to undergraduate students across two campuses. The first goal was to determine if Moodle Workshop awarded a fair peer grader grade. The second objective was to estimate if…

The National Survey of Student Engagement (NSSE) Benchmarks has emerged as a competing paradigm for assessing institutional effectiveness vis-a-vis the U.S. News & World Report. However, Porter (2009) has critiqued it for failing to meet validity and reliability standards. This study investigated whether the NSSE five benchmarks had construct…

This mixed methods study explored the nature of a benchmark assessment program and how well the benchmark assessments predicted End-of-Grade (EOG) and End-of-Course (EOC) test scores in an American Indian school district. Five major themes were identified and used to develop a Dimensions of Benchmark Assessment Program Effectiveness model:…

Assessment is at the center of a decision-making model within a Response to Intervention (RTI) framework. Assessments that can be used for universal screening and progress monitoring in early childhood RTI models are needed that are both psychometrically sound and appropriate to meet developmental needs of young children. The Preschool Early…

The fuzziness of assessing second language speaking performance raises two difficulties in scoring speaking performance: "indistinction between adjacent levels" and "overlap between scales". To address these two problems, this article proposes a new approach, "confidence scoring", to deal with such fuzziness, leading to "confidence" scores between…

Purpose: The American University of Beruit has generated a model for student success that builds on Kuh's five benchmarks of academic practice. The purpose of this study is to investigate the psychometric properties of the measures used to assess effectiveness of the benchmarks. Design/methodology/approach: Using a database of student responses to…