In this digital ITEMS module, Dr. Sue Lottridge, Amy Burkhardt, and Dr. Michelle Boyer provide an overview of automated scoring. Automated scoring is the use of computer algorithms to score unconstrained open-ended test items by mimicking human scoring. The use of automated scoring is increasing in educational assessment programs because it allows…

One of the areas subsumed under the data-based decision making and accountability practice identified in the National Association of School Psychologists' (NASP) "Model for Integrated School Psychological Services" is to collect information on psychological and educational variables to make decisions at a number of levels of service…

We developed a brief, informant-report interview for assessing autism spectrum conditions (ASC) in adults, called the Developmental, Dimensional and Diagnostic Interview-Adult Version (3Di-Adult); and completed a preliminary evaluation. Informant reports were collected for participants with ASC (n = 39), a non-clinical comparison group (n = 29)…

This manuscript chronicles the process and products of a redesign for evaluation of the graduate college experience (GCE) which was initiated by a university graduate college, based on its observed need to reconsider and update its measures and methods for assessing graduate students' experiences. We examined the existing instrumentation and…

Most organic chemistry reactions occur by a mechanism that includes acid-base chemistry, so it is important that students develop and learn to use correct conceptions of acids and acid strength. Recent studies have described undergraduate organic chemistry students' cognitive resources related to the Brønsted-Lowry acid model and the Lewis acid…

Conceptualisations of disability that emphasise the contextual and cultural nature of disability and the embodiment of these within a national system of data collection present a number of challenges especially where this process is devolved to schools. The requirement for measures based on contextual and subjective experiences gives rise to…

Background: Health disparities between adults with intellectual disabilities (ID) and the general population have been well documented but, to date, no dedicated assessment battery for measuring health disparity has been available. This paper reports on the development and testing of a multinational assessment battery for collecting data on a…

This article has three goals. The first goal is to clarify the role that the consequences of test score use play in validity judgments by reviewing the role that modern writers on validity have ascribed for consequences in supporting validity judgments. The second goal is to summarize current views on who is responsible for collecting evidence of…

This paper describes the confirmatory factor analysis, validity, and reliability data collection stage of the development of a scale to measure mainstream teachers' self-efficacy beliefs for teaching ELL (English Language Learner) students. Data were collected from 708 K through 12 teachers and pre-service teachers with varying degrees of…

Background: Coaches and physical educators must obtain valid data relating to the contribution of each of their players in order to assess their level of performance in team sport competition. This information must also be collected and used in real game situations to be more valid. Developed initially for a physical education class context, the…

Explored applicability of the Loevinger conception of ego development for early adolescence and developed a measure of earliest ego levels: Sentence Completion Test for Children and Youth. Found oral administration of test did not yield essentially different responses or significantly differing ego-level scores from the written version, regardless…

The Parent-Child Conflict Tactics Scales (CTSPC), a version of the well-established Conflict Tactics Scales, was developed to improve its ability to obtain data on physical and psychological child maltreatment. The conceptual and methodological approaches used to develop the CTSPC are described and psychometric data, including reliability,…

This paper reports 20 unsolved problems in educational measurement and points toward what seem to be promising avenues of solution. The first group of concerns involves validity, posing the problems of obtaining suitable validity criteria, determining and measuring the predictor variables that best characterize the traits and proficiencies of…

This text was developed on an autoinstructional basis to familiarize the reader with the various interpretations of reliability and validity, their measurement and evaluation, and factors influencing their measurement. The text enables those with prior knowledge of statistics to increase their understanding of variance and correlation. Review…

This report summarizes findings from a study of the psychometric properties of the resilience and youth development module, a key component of the Healthy Kids Survey. The study aims to improve resilience assessment and research so that educators can shape the school environment to promote academic resilience. The Healthy Kids Survey (HKS) is a…