In April 2021, The Association for Assessment and Research in Counseling Executive Council commissioned a time-referenced task group to revise the Responsibilities of Users of Standardized Tests (RUST) Statement (3rd edition) published by the Association for Assessment in Counseling (AAC) in 2003. The task group developed a work plan to implement…

This paper presents improvements made to a computerized adaptive testing (CAT)-based version of the FCI (FCI-CAT) in regards to test security and test efficiency. First, we will discuss measures to enhance test security by controlling for item overexposure, decreasing the risk that respondents may (i) memorize the content of a pretest for use on…

The digital transition in educational testing has introduced many new opportunities for technology to enhance large-scale assessments. These include the potential to collect and use log data on test-taker response processes routinely, and on a large scale. Process data has long been recognised as a valuable source of validation evidence in…

Social and Emotional Learning and Its Measurement: The ability to understand and effectively interact with others is a critical determinant of academic, social, and life success (DiPerna & Elliott, 2002). This fact is increasingly recognized in educational policy and practice. For example, an influential report by the National Academy of…

The purpose of this study was to replicate the structure of mental speed and relations evidenced with fluid intelligence (Gf) found in a number of recent studies. Specifically, a battery of computerized tasks examined whether results with paper-and-pencil assessments held across different test media. Participants (N = 186) completed the battery,…

This chapter addresses the psychometric challenges in assessing English language learners (ELLs) and students with disabilities (SWDs). The first section addresses some general considerations in the assessment of ELLs and SWDs, including the prevalence of ELLs and SWDs in the student population, federal and state legislation that requires the…

Many innovative item formats have been proposed over the past decade, but little empirical research has been conducted on their measurement properties. This study examines the reliability, efficiency, and construct validity of two innovative item formats--the figural response (FR) and constructed response (CR) formats used in a K-12 computerized…

As part of a Response to Intervention (RTI) model, curriculum-based measurement (CBM) is an evidence-based assessment system that uses screening and formative assessments to help guide instruction. The two primary purposes of this study are to examine the relations between the easyCBM benchmark measures and a statewide large-scale assessment and…

Among the areas of emphasis in the language-teaching profession today we find considerable emphasis on (a) evaluation, (b) contextualization, and (c) technology. Although the greater emphasis in language assessment has been on global proficiency, there is also a need to examine specific points of students' language competence in order to help them…

Schools and districts should use a well-designed needs assessment to inform important decisions about a range of technology program areas. Presently, there is a lack of valid and reliable instruments available and accessible to schools to effectively assess their educational needs to better design and evaluate their projects and initiatives. The…

This technical report documents the procedures followed in developing student and teacher surveys to gather information about the accommodations students are accustomed to receiving and those that might be beneficial on a mathematics test delivered on the computer. It provides documentation of the technical adequacy of the survey instruments, as…