This report summarizes some of the evidence supporting interpretations of scores from the enhanced ACT, focusing on reliability, concurrent validity, predictive validity, and score comparability. The authors argue that the evidence presented in this report supports the interpretation of scores from the enhanced ACT as measures of high school…

Cultural intelligence is one's ability to adapt when confronted with problems arising in interactions with people or artifacts of diverse cultures. In this study, we conduct an initial construct-validation and assessment of a maximum-performance test of cultural intelligence. We assess the psychometric properties of the test and also correlate the…

Computer-based testing is an expanding use of technology offering advantages to teachers and students. We studied Calculus II classes for science, technology, engineering, and mathematics majors using different testing modes. Three sections with 324 students employed: paper-and-pencil testing, computer-based testing, and both. Computer tests gave…

Average score change: How big is big? This paper discusses school-level changes in average ACT scores and highlights an interactive tool designed to facilitate score change comparisons.

Procedures for identifying the gifted often make use of tests of general intelligence, among other assessments. Robert J. Sternberg recently suggested that identification of the gifted should further involve assessment of what he refers to as adaptive intelligence--the ability to adapt to real-world environments. Such a conception of intelligence…

There is a tradeoff between scale length and psychometric concerns. The two are, in fact, directly linked. Generally, when scales are shortened, reliability is reduced, and when scales are lengthened, reliability is improved, provided the items added to the scale are comparable psychometrically (AERA et al., 2014). Scale reliability, in turn,…

Proficiency with written communication (WC) is critical for success in college and careers. As a result, institutions face a growing challenge to accurately evaluate their students' writing skills to obtain data that can support demands of accreditation, accountability, or curricular improvement. Many current standardized measures, however, lack…

The Every Student Succeeds Act requires that English Learners (ELs) are included in annual state testing (grades 3-8 and once in high school) and included in each state's accountability system disaggregated by subgroup to ensure that they receive the support they need to learn English, participate fully in their education experience, and graduate…

ACT reporting categories and ACT Readiness Ranges are new features added to the ACT score reports starting in fall 2016. For each reporting category, the number correct score, the maximum points possible, the percent correct, and the ACT Readiness Range, along with an indicator of whether the reporting category score falls within the Readiness…

Undergraduate grade point average (GPA) is a commonly employed measure in educational research, serving as a criterion or as a predictor depending on the research question. Over the decades, researchers have used a variety of reliability coefficients to estimate the reliability of undergraduate GPA, which suggests that there has been no consensus…

States and districts have expressed interest in administering the ACT® to 10th-grade students. Given that the ACT was designed to be administered in the spring of 11th grade or fall of 12th grade, the appropriateness of this use should be evaluated. As such, the focus of this paper is to summarize empirical evidence evaluating the use of the ACT…

This chapter is a research summary of the author's doctoral dissertation completed in May, 2015, which investigates the way Standardized Assessment (SA) is used in state educational accountability structures. This quasi-experimental quantitative study found that SA scores trend towards consistency over time, and that there is additional variance,…

In order to comply with the regulations put forth by the Elementary and Secondary Education Act (ESEA), as amended by the Every Student Succeeds Act (ESSA), states are required to submit evidence associated with their statewide accountability systems to the United States Department of Education (ED) for peer review. Some states have elected to…

Over the past decade, there has been greater recognition by educators, employers, and policymakers of the importance of behavioral skills and navigation factors (e.g., dependability, cooperation, interests, and goals) for education and career success. A growing body of research shows that these factors contribute to diverse positive outcomes in…

Critical thinking is a learning outcome highly valued by higher education institutions and the workforce. The Educational Testing Service (ETS) has designed a next generation assessment, the HEIghten™ critical thinking assessment, to measure students' critical thinking skills in analytical and synthetic dimensions. This paper introduces the…