This paper proposes two new item selection methods for cognitive diagnostic computerized adaptive testing: the restrictive progressive method and the restrictive threshold method. They are built upon the posterior weighted Kullback-Leibler (KL) information index but include additional stochastic components either in the item selection index or in…

We propose three latent scales within the framework of nonparametric item response theory for polytomously scored items. Latent scales are models that imply an invariant item ordering, meaning that the order of the items is the same for each measurement value on the latent scale. This ordering property may be important in, for example,…

Based on Maryland's 2017-2018 Kindergarten Readiness Assessment (KRA) results, nearly half of all entering kindergarten children show foundational skills indicating they are fully ready for kindergarten, more than a third are approaching readiness, and 18% have emerging readiness skills. Results for the 2017-2018 school year show a slight increase…

In this study, we investigated gender and minority achievement gaps on 8th-grade science items employing a multilevel item response methodology. Both gaps were wider on physics and earth science items than on biology and chemistry items. Larger gender gaps were found on items with specific topics favoring male students than other items, for…

This study compared classroom interactive behaviors of science pre-service teachers and pre-service teachers of other subjects. Participants included pre-service teachers enrolled in a general methods course for secondary educators and its school-based fieldwork counterpart. Statistical tests found that science pre-service teachers had fewer…

Reviewing the test specifications to improve the quality of language tests may be a routine process in professional testing systems. However, there is a paucity of research about the effect of specifications review on improving the quality of small-scale tests. The purpose of the present study was twofold: how specifications review could help…

This article describes a hybrid standard setting method that combines characteristics of the Angoff (1971) and Bookmark (Mitzel, Lewis, Patz & Green, 2001) methods. The proposed approach utilizes strengths of each method while addressing weaknesses. An ordered item booklet, with items sorted based on item difficulty, is used in combination…

This article describes the development of the Redox Concept Inventory (ROXCI) as a measure of students' understandings and confidence of both the symbolic and particulate domains of oxidation-reduction (redox) reactions. The ROXCI was created using a mixed-methods design in which the items were developed based upon themes that emerged from…

Between March and June of 2014, the Smarter Balanced Assessment Consortium conducted a field test of its new online assessment system. Thirteen participating states provided the results of surveys given to students and adults involved in the Field Test. Overall, more than 70% of test coordinators in each of seven states indicated that the Field…

Learning taxonomies can assist faculty in developing course structures that promote enhanced student learning in the cognitive and affective domains. Significant Learning is one approach to course design that allows for development in six key areas: Foundational Knowledge, Application, Integration, Human Dimension, Caring, and Learning How to…

The purpose of this qualitative research study is to analyze instructors' exam questions at a Primary Education Department in terms of the exam's period, the comprehensibility of the instructions, cognitive level, and the appropriateness to the critical thinking. This qualitative study is based on document analysis method. 100 randomly selected…

The public understanding of science is a term now considered somewhat narrow and carrying connotations of a "deficit model" of the public. Since the late 1980s, however, regular public surveys have been conducted to find out what facts about science the public knows. These include such questions as whether the Earth goes round the Sun,…

In recent years, there has been increasing interest in estimating and improving subscore reliability. In this study, the multidimensional item response theory (MIRT) and the bi-factor model were combined to estimate subscores, to obtain subscores reliability, and subscores classification. Both the compensatory and partially compensatory MIRT…

A basic level of literacy and numeracy is essential for full participation in modern societies. While very few people in most of the advanced countries could be regarded as illiterate or innumerate, recent studies have shown that there are, in fact, significant numbers of people with poor skills, and that low levels of skills are associated with…

Organizational stressors can potentially elicit a number of undesirable consequences for sport performers. It is, therefore, imperative that psychologists better understand the demands that athletes encounter via their exploration and assessment. However, although researchers have identified a wide range of organizational stressors in competitive…