The "Standards for Educational and Psychological Testing" have served as a cornerstone for best practices in assessment. As the field evolves, so must these standards, with regular revisions ensuring they reflect current knowledge and practice. The National Council on Measurement in Education (NCME) conducted a survey to gather feedback…

This preliminary study developed the concept map tool "BR-Map" using learning logs on eBook viewer, and investigated the relationships between self-regulated learning (SRL) awareness, learning behaviors (usage of BR-Map, and one-minute paper and report submission), and learning performance. Psychometric data and learning logs were…

This paper briefly discusses four measurement challenges of data science or "big data" in educational assessments that are enabled by technology: 1. Dealing with change over time via time-based data. 2. How a digital performance space's relationships interact with learner actions, communications and products. 3. How layers of…

The INTASC Principles, when used as the basis for developing appropriate measurement instruments to assess teacher dispositions, provide a viable approach to the diagnosis and remediation of skill-related affective performance in teacher candidates and also to meeting NCATE requirements for Standard 1. In this symposium, the development and use of…

The usefulness of L. Guttman's partial order scalogram analysis is investigated in this study of the structure of a set of items that measure attitudes toward legal abortion. These items, drawn from the National Opinion Research Center's "General Social Survey," have been the focus of considerable applied research investigating…

Some of the issues regarding the estimation of reliability for performance assessments are explored, and a methodology is suggested for determination of reliability. In performance assessment, the magnitude of the reliability coefficient may be less than that obtained for a standardized test, since part of the potential use of performance…

The effects of a multidimensional latent trait space on estimation of item and person parameters by the computer program LOGIST are examined. Several item pools were simulated that ranged from truly unidimensional to an inconsequential general latent trait. Item pools with intermediate levels of prepotency of the general latent trait were also…

This paper reviews the basic elements of the EM approach to estimating item parameters and illustrates its use with one simulated and one real data set. In order to illustrate the use of the BILOG computer program, runs for 1-, 2-, and 3-parameter models are presented for the two sets of data. First is a set of responses from 1,000 persons to five…

This study investigated the construct validity of the revised Special Education-Mental Handicaps Georgia Teacher Certification Test (MH-TCT) using hierarchical confirmatory factor analysis and LISREL VI. The primary objective was to determine whether first-order and second-order factors correspond to item/objective/test relationships defined by…