The interpretation of psychometric test results is usually based on norm scores. We compared semiparametric continuous norming (SPCN) with conventional norming methods by simulating results for test scales with different item numbers and difficulties via an item response theory approach. Subsequently, we modeled the norm scores based on random…

In preparation for online administration of the ACT® test, ACT conducted studies to examine the comparability of scores between online and paper administrations, including a timing study in fall 2013, a mode comparability study in spring 2014, and a second mode comparability study in spring 2015. This report presents major findings from these…

Limited evidence supports the external validity of the distinction between developmental phonological and surface dyslexia. We previously identified children ages 8 to 13 meeting criteria for these subtypes (Peterson, Pennington, & Olson, 2013) and now report on their reading and related skills approximately 5 years later. Longitudinal…

This work is a comparative study of JSCE results between the 6-3-3-4 system (2006 & 2008) and the 9-3-4 (UBE) system (2009 & 2011) in Port Harcourt using a comparative/evaluative survey design. A cluster sampling technique was used to compose a sample of 2,487 drawn from the population of 17,139 candidates in 2006, 2008, 2009 and 2011 in…

We compared 5 different statistics (i.e., G index, gamma, "d'", sensitivity, specificity) used in the social sciences and medical diagnosis literatures to assess calibration accuracy in order to examine the relationship among them and to explore whether one statistic provided a best fitting general measure of accuracy. College…

Many tests provide users with several different types of scores to facilitate interpretation and description of students' performance. Common examples include raw scores, age- and grade-equivalent scores, and standard scores. However, when used within the context of assessing growth among young children, these scores should not be interchangeable…

A recent comparative analysis of alternative interval estimation approaches and procedures has shown that confidence intervals (CIs) for true raw scores determined with the Score method--which uses the normal approximation to the binomial distribution--have actual coverage probabilities that are closest to their nominal level. It has also recently…

Purpose: The Renfrew Bus Story--North American Edition (RBS-NA; C. Glasgow & J. Cowley, 1994) is widely used in clinical and research settings to determine children's language abilities, although possible influences of race and maternal education on RBS-NA performance are unknown. The current study compared RBS-NA retells of 4 groups of children:…

The population sensitivity of vertical scaling results was evaluated for a state reading assessment spanning grades 3-10 and a state mathematics test spanning grades 3-8. Subpopulations considered included males and females. The 3-parameter logistic model was used to calibrate math and reading items and a common item design was used to construct…

High-stakes assessments have encouraged educators to ignore the needs of the top performers. Therefore, the Oakwood School District decided to implement a mathematics pilot enrichment program in order to meet the needs of the advanced mathematics students. As a result, this study used quantitative data to determine if there was a significant…

The purpose of this paper is to explore methods to approximate population invariance without conducting multiple linkings for subpopulations. Under the single group or equivalent groups design, no linking needs to be performed for the parallel-linear system linking functions. The unequated raw score information can be used as an approximation. For…

This study uses historical data to explore the consistency of SAT® I: Reasoning Test score conversions and to examine trends in scaled score means. During the period from April 1995 to December 2003, both Verbal (V) and Math (M) means display substantial seasonality, and a slight increasing trend for both is observed. SAT Math means increase more…

Randomly equivalent forms (REF) of tests in listening and reading for nonnative speakers of English were created by stratified random assignment of items to forms, stratifying on item content and predicted difficulty. The study included 50 replications of the procedure for each test. Each replication generated 2 REFs. The equivalence of those 2…

Rasch model vertical equating procedures were applied to three mathematics computation tests for grades six, seven, and eight. Each level of the test was composed of 45 items in three sets of 15 items, arranged in such a way that tests for adjacent grades had two sets (30 items) in common, and the sixth and eighth grades had 15 items in common. In…

The interpretation of test profiles, graphic devices which indicate the overall performance of an individual or group of individuals, is discussed. Some uses of profiles are presented, together with a three step profile analysis procedure for interpreting test results. Because profiles are relatively simple to construct and appear to be easily…