The nature of the matching criterion (usually the total score) in the study of differential item functioning (DIF) has been shown to impact the accuracy of different DIF detection procedures. One of the topics related to the nature of the matching criterion is whether the studied item should be included. Although many studies exist that suggest…

Crossing, or intersecting, differential item functioning (DIF) is a form of nonuniform DIF that exists when the sign of the between-group difference in expected item performance changes across the latent trait continuum. The presence of crossing DIF presents a problem for many statistics developed for evaluating DIF because positive and negative…

We have designed, developed, and validated a 17-question Meiosis Concept Inventory (Meiosis CI) to diagnose student misconceptions on meiosis, which is a fundamental concept in genetics. We targeted large introductory biology and genetics courses and used published methodology for question development, which included the validation of questions by…

Although a substantial amount of research has been conducted on differential item functioning in testing, studies have focused on detecting differential item functioning rather than on explaining how or why it may occur. Some recent work has explored sources of differential functioning using explanatory and multilevel item response models. This…

The assessment of test data for the presence of differential item functioning (DIF) is a key component of instrument development and validation. Among the many methods that have been used successfully in such analyses is the mixture modeling approach. Using this approach to identify the presence of DIF has been touted as potentially superior for…

When missing values are present in item response data, there are a number of ways one might impute a correct or incorrect response to a multiple-choice item. There are significantly fewer methods for imputing the actual response option an examinee may have provided if he or she had not omitted the item either purposely or accidentally. This…

This study investigates university students' understanding of graphs in three different domains: mathematics, physics (kinematics), and contexts other than physics. Eight sets of parallel mathematics, physics, and other context questions about graphs were developed. A test consisting of these eight sets of questions (24 questions in all) was…

This research examines whether the ordering of the difficulty of exams can influence student beliefs about their academic abilities and the impact of these beliefs on their performance. The ordering of the difficulty of test items has shown to affect performance. Study One (n = 91) examined college student differences in reaction to a difficult…

With the increasing emphasis placed upon chemistry instructors and departments to assess and evaluate their courses and curricula, understanding the structure of chemistry faculty members' knowledge and use of assessment terms and concepts can shed light on potential areas for targeted professional development. Survey research that might…

We investigated time-related patterns in levels of cognitive performance during the period from 1970 to 1993 based on data from Swedish draft boards. The conscripts, including more than a million 18-19-year old men, had taken one of two versions of the Swedish enlistment battery (SEB67; 1970-1979 or SEB80; 1980-1993), each composed of four…

Five hundred and seventeen words from the easyCBM Word Reading assessment (n = 57 kindergarten, 117 first grade, 172 second grade, and 171 third grade) were examined by 15 teachers for their correspondence with the Common Core State Standards in English Language Arts. In particular, the degree of correspondence between Standard 3 ("Phonics…

Students often have trouble understanding key biology ideas, in part because they lack an understanding of foundational chemistry ideas. AAAS [American Association for the Advancement of Science] is collaborating with BSCS [Biological Sciences Curriculum Study] in the development of a curriculum unit that connects core chemistry and biology ideas…

Proportional reasoning is important for informed decisions in proportional problem situations. This paper reports on mathematical content knowledge related to proportional reasoning of second-year, pre-service teachers. Responses to two ratio items provide insights into their correct method of solutions and common misconceptions. Anchor Points…

This study explored the data-based decision making of 12 teachers in grades 6-8 who were asked about their perceptions and use of three required interim measures of reading performance: oral reading fluency (ORF), retell, and a benchmark comprised of released state test items. Focus group participants reported they did not believe the benchmark or…

As part of an ongoing investigation of students' learning in first semester upper-division quantum mechanics, we needed a high-quality conceptual assessment instrument for comparing outcomes of different curricular approaches. The process of developing such a tool started with converting a preliminary version of a 14-item open-ended quantum…