According to Helms, "test fairness" is defined as "removal from test scores of systematic variance attributable to experiences of racial or cultural socialization." Some of Helms's reasoning is based on earlier work, which recommended that racial group or category variables be replaced entirely with individual-level constructs, to reflect racial…

Speededness refers to the situation where the time limits on a standardized test do not allow substantial numbers of examinees to fully consider all test items. When tests are not intended to measure speed of responding, speededness introduces a severe threat to the validity of interpretations based on test scores. In this article, we describe…

Just as comprehension strategies have helped millions of students learn to read like proficient readers, they can also help students think like effective test-takers. The authors show how students can use background knowledge, mental images, synthesizing, monitoring, inferring, questioning, and determining of importance to understand the genre of…

Response times on items can be used to improve item selection in adaptive testing provided that a probabilistic model for their distribution is available. In this research, the author used a hierarchical modeling framework with separate first-level models for the responses and response times and a second-level model for the distribution of the…

This article reports on an analysis of alignment between NY state core curricula and NY Regents tests in physics and chemistry. Both the curriculum and test were represented by a two dimensional table consisting of topics and cognitive demands. The cell values of the table were numbers of major understandings in the curriculum and points of test…

In response to Barry McGaw's article "The role of the OECD in international comparative studies of achievement", this contribution explores two issues which the author considers closely interrelated. The first issue concerns the quality of the items produced to assess reading skills in the OECD-PISA and OECD-SIALS studies and the…

Teacher assessment literacy is a key factor in the success of teaching, but some studies concluded that teachers lack it. The aim of this research is to propose the ''Practicing, Reflecting and Revising with WATA system (P2R-WATA) Assessment Literacy Development Model'' for improving pre-service teacher assessment literacy. WATA system offers…

Common items with inconsistent b-parameter estimates may have a serious impact on item response theory (IRT)--based equating results. To find a better way to deal with the outlier common items with inconsistent b-parameters, the current study investigated the comparability of 10 variations of four IRT-based equating methods (i.e., concurrent…

The purpose of this study was to determine (1) strategies students use when solving composition problems and the difficulties they encounter; (2) conceptions and/or misconceptions students have with respect to composition of functions; and (3) the effect of using dynamic visualization during instruction on students' understanding of composition of…

Prior research across hundreds for introductory physics courses has demonstrated that traditional physics instruction does not generally lead to students learning physics concepts in a meaningful way, but that interactive-engagement physics courses do sometimes promote a great deal more student learning. In this work I analyze a reform effort in a…

The paper gives an overview of multidimensional adaptive testing (MAT) and evaluates its applicability in educational and psychological testing. The approach of Segall (1996) is described as a general framework for MAT. The main advantage of MAT is its capability to increase measurement efficiency. In simulation studies conceptualizing situations…

This study linked nonlinear profile analysis (NPA) of dichotomous responses with an existing family of item response theory models and generalized latent variable models (GLVM). The NPA method offers several benefits over previous internal profile analysis methods: (a) NPA is estimated with maximum likelihood in a GLVM framework rather than…

The study was conducted with 3,385 participants who took an English language proficiency test as a partial requirement for entering a PhD program in different fields of education. This test has three sections which are grammar, vocabulary and reading comprehension. To determine the construct validity of the test, a series of analyses were done.…

In May 2008, the National Assessment Program--Literary and Numeracy (NAPLAN) conducted nation-wide tests for reading, writing, language conventions, and numeracy. A national assessment program of this kind should provide the stimulus for macro-level (systemic) analytical studies and micro-level (individual school and/or class) analytical studies…

Large data sets from a state reading assessment for third and fifth graders were analyzed to examine differential item functioning (DIF), differential distractor functioning (DDF), and differential omission frequency (DOF) between students with particular categories of disabilities (speech/language impairments, learning disabilities, and emotional…