Universitas 21 Ranking of National Higher Education Systems (U21 Ranking) is one of the three new ranking systems appearing in 2012. In contrast with the other systems, U21 Ranking uses countries as the unit of analysis. It has several features which lend it with greater trustworthiness, but it also shared some methodological issues with the other…

In several studies unit-weighted sum scales based on the unweighted sum of items are derived from the pattern of salient loadings in confirmatory factor analysis. The problem of this procedure is that the unit-weighted sum scales imply a model other than the initially tested confirmatory factor model. In consequence, it remains generally unknown…

In this study, I investigated 2 procedures intended to create test-taker groups of equal ability by poststratifying on a composite variable created from demographic information. In one procedure, the stratifying variable was the composite variable that best predicted the test score. In the other procedure, the stratifying variable was the…

GMAT (Graduate Management Admission Test) scaled scores convey the same level of ability over time, and GMAT percentiles convey the competitiveness of scores relative to today's GMAT test takers. In an earlier column, the author discussed the role of the GMAT scaled scores and percentiles. Here, he gets more technical and discusses how GMAT scaled…

Limited evidence supports the external validity of the distinction between developmental phonological and surface dyslexia. We previously identified children ages 8 to 13 meeting criteria for these subtypes (Peterson, Pennington, & Olson, 2013) and now report on their reading and related skills approximately 5 years later. Longitudinal…

This booklet grew out of a half-day class on equating that author Samuel Livingston teaches for new statistical staff at Educational Testing Service (ETS). The class is a nonmathematical introduction to the topic, emphasizing conceptual understanding and practical applications. The class consists of illustrated lectures, interspersed with…

This work is a comparative study of JSCE results between the 6-3-3-4 system (2006 & 2008) and the 9-3-4 (UBE) system (2009 & 2011) in Port Harcourt using a comparative/evaluative survey design. A cluster sampling technique was used to compose a sample of 2,487 drawn from the population of 17,139 candidates in 2006, 2008, 2009 and 2011 in…

Selection to programmes for gifted students in Israel, performed in the second grade, relies on raw ability and achievement test scores, irrespective of age, thereby ignoring the well-known effect of within-grade age differences on test scores. Employing the entire cohort of third graders of legal age (67,366 students, 1.4% of whom were enrolled…

Although researchers in undergraduate science, technology, engineering, and mathematics education are currently using several methods to analyze learning gains from pre- and posttest data, the most commonly used approaches have significant shortcomings. Chief among these is the inability to distinguish whether differences in learning gains are due…

Because the demand for subscores is ever increasing, this study examined two different approaches for equating subscores: (a) equating a subscore on the new form to the same subscore in the old form using internal common items as the anchor to conduct the equating, and (b) equating a subscore on the new form to the same subscore in the old form…

Frustrations with traditional testing led a group of teachers at the English for adults program at Universidad EAFIT (Colombia) to design tests aligned with the institutional teaching philosophy and classroom practices. This article reports on a study of an item-by-item evaluation of a series of English exams for validity and reliability in an…

The purpose of this study was to investigate the potential impact of misrouting under a 2-stage multistage test (MST) design, which includes 1 routing and 3 second-stage modules. Simulations were used to create a situation in which a large group of examinees took each of the 3 possible MST paths (high, middle, and low). We compared differences in…

Individually administered tests are often normed on small samples, a process that may result in irregularities within and across various age or grade distributions. Test users often smooth distributions guided by Thurstone assumptions (normality and linearity) to result in norms that adhere to assumptions made about how the data should look. Test…

Problem Statement: Individuals tend to prefer a vocation in order to reach their targets such as leading a life, nutrition, housing, being safe, having a good position in society etc. It is a task of the adolescence period to choose a vocation which is for some the most important step of the life, while for some others it is a rather important…

The identification of differential item functioning (DIF) is often performed by means of statistical approaches that consider the raw scores as proxies for the ability trait level. One of the most popular approaches, the Mantel-Haenszel (MH) method, belongs to this category. However, replacing the ability level by the simple raw score is a source…