While it is true that every history is composed of facts, there is something more to history, something that makes it more than just the sum of its factual claims. That something is called narrative. A narrative is not simply a story (although it may be that). Rather, it is a structure for organizing factual claims. As many historians have noted,…

This study investigated the use of latent class analysis for the detection of differences in item functioning on the Peabody Picture Vocabulary Test-Third Edition (PPVT-III). A two-class solution for a latent class model appeared to be defined in part by ability because Class 1 was lower in ability than Class 2 on both the PPVT-III and the…

Item response theory (IRT) procedures have been used extensively to study normal latent trait distributions and have been shown to perform well; however, less is known concerning the performance of IRT with non-normal latent trait distributions. This study investigated the degree of latent trait estimation error under normal and non-normal…

This research builds upon prior validation studies of the Community of Inquiry (CoI) survey by utilizing multiple rating measures to validate the survey's tripartite structure (teaching presence, social presence, and cognitive presence). In prior studies exploring the construct validity of these 3 subscales, only respondents' course ratings were…

Assessing individual change is an important topic in both psychological and educational measurement. An adaptive measurement of change (AMC) method had previously been shown to exhibit greater efficiency in detecting change than conventional nonadaptive methods. However, little work had been done to compare different procedures within the AMC…

The promulgation of ESL learning standards by government agencies and professional organizations is intended to improve second-language (L2) proficiency and academic achievement. However, mandates have been criticized on various grounds, including difficulty of defining domains to be tested as well as vagueness of articulation. Arising from the…

"Conners 3rd Edition" is the most updated version of a series of measures for assessing attention deficit hyperactivity disorder (ADHD) and common comorbid problems/disorders in children and adolescents ranging from 6 to 18 years of age. Related problems that the test helps assess include executive dysfunction, learning problems, aggression, and…

Advances in natural language processing (NLP) and automatic speech recognition and processing technologies offer new opportunities for language testing. Despite their potential uses on a range of language test item types, relatively little work has been done in this area, and it is therefore not well understood by test developers, researchers or…

The objectives of this study were (a) to investigate whether items of the Chinese version of Beck Depression Inventory II (BDI-II-C; "Chinese Behavioral Science Corporation" in "Manual for the Beck Depression Inventory-II" [in Chinese]. The Chinese Behavioral Science Corporation, Taiwan, 2000) exhibited DIF across adolescent…

In the United States, students who are deaf or hard of hearing (SDHH) are required to participate in high-stakes standardized assessments under No Child Left Behind reforms. In 2006-2007, states added science to reading and mathematics as a tested content area. Many SDHH participate in these assessments using testing accommodations, but teachers…

After a test is developed, most content validation analyses shift from ascertaining domain definition to studying domain representation and relevance because the domain is assumed to be set once a test exists. We present an approach that allows for the examination of alternative domain structures based on extant test items. In our example based on…

There has been little data collected on how much testing actually goes on in America's schools and how the results are used. So in the Spring of 2014, the Council staff developed and launched a survey of assessment practices. This report presents the findings from that survey and subsequent Council analysis and review of the data. It also offers…

The purpose of this study was to examine Differential Item Functioning (DIF) by disability groups on an on-demand performance assessment for students with severe cognitive impairments. Researchers examined the presence of DIF for two comparisons. One comparison involved students with severe cognitive impairments who served as the reference group…

A quantitative observational study exploring the relationship of gender to mathematics self-efficacy and the frequency of back substitution in multiple-choice assessment sampled undergraduates at a western United States parochial university. Research questions addressed: to what extent are there gender differences in mathematics self-efficacy, as…

The attribute hierarchy method (AHM) is a psychometric procedure for classifying examinees' test item responses into a set of structured attribute patterns associated with different components from a cognitive model of task performance. Results from an AHM analysis yield information on examinees' cognitive strengths and weaknesses. Hence, the AHM…