This paper illustrates that the psychometric properties of scores and scales that are used with mixed-format educational tests can impact the use and interpretation of the scores that are reported to examinees. Psychometric properties that include reliability and conditional standard errors of measurement are considered in this paper. The focus is…

In this article we provide a critique of the interpretation and utilization of Programme for International Student Assessment (PISA) results by the National Education Authorities in Turkey. First, we define and explain what OECD's PISA is. Second, we make an overview of the media coverage in Turkey of the PISA 2003 and 2006 results. Third, we…

Paul Newton (2010), with his characteristic concern about theory, has set out two different ways of thinking about the basis upon which equivalences of one sort or another are established between test score scales. His reason for doing this is a desire to establish "the defensibility of linkages lower on the continuum than concordance."…

This article presents the author's rejoinder to thinking about linking from issue 8(1). Particularly within the more embracing linking frameworks, e.g., Holland & Dorans (2006) and Holland (2007), there appears to be a major disjunction between (1) classification discourse: the supposed basis for classification, that is, the underlying theory…

"Linking" is a term given to a general class of procedures by which one represents scores X on one test or measure in terms of scores Y on another test or measure. A recent taxonomy by Holland and Dorans (2006; Holland, 2007) organizes the various types of links into three broad categories: prediction, scale aligning, and equating. In…

Newton's article (2010) makes three main contributions to the literature. First, it is transatlantic, bringing together literatures that have been dealing with similar problems, using sometimes different methods and certainly with distinctive educational, cultural perspectives. He points out that neither of these literatures has all of the…

The article "Thinking About Linking" by Newton (2010) presents a novel philosophical perspective on the way that educational assessments should be linked. Newton starts by describing the linking framework as it was characterized in various publications and identifies a cross-cultural dimension in the definitions and uses of test…

Updates an earlier study by reanalyzing interstate variations in Scholastic Aptitude Test and American College Test scores. Reaffirms the conclusion that state rankings based on such scores change dramatically when adjusted for number of test takers or class rank of test-taking population. Finds that public expenditures are positively related to…

This document discusses the scores of Albuquerque (New Mexico) Public Schools (APS) students on the American College Test (ACT) and the Scholastic Aptitude Test (SAT) during the 1982-83 school year. Graphs, a map, and a question and answer format are used to report the information. Comparisons of average ACT scores and average SAT scores are drawn…

Three short forms of the Wechsler Adult Intelligence Scale-Revised (WAIS-R), developed in 1991, were cross-validated on 207 male and 133 female adolescent psychiatric inpatients and outpatients. Results show psychometric properties for the short forms that are comparable to those of the WAIS-R standardization sample. (SLD)

The state-by-state comparisons of results on the 1998 National Assessment of Educational Progress (NAEP) present the literacy community with some good news and a bit of a puzzle: scores have improved, but the results cannot provide answers as to why one grade or state is doing better or worse than in the past. State-by-state results show that…

We examine the equivalence of two construct-a-concept-map techniques: construct-a-map with created linking phrases (C), and construct-a-map with selected linking phrases (S). The former places few constraints on the respondent and has been considered the gold standard; the latter is cost and time efficient. Both their products and processes are…

Argues that colleges can use Verbal SAT scores to place freshmen in reading courses when comprehension measures are not available. (HOD)

During the past 6 years, under a contract from the National Center for Education Statistics, a Technical Review Panel has overseen and conducted a series of research studies addressing a range of validity questions relevant to the various uses and interpretations of the National Assessment of Educational Progress (NAEP). Study topics included: (1)…

The most fundamental technical quality issue raised by proposals for a national examination system is that of validity. Types of evidence needed to judge the validity of test use and the interpretation of results are discussed, and examination content, fairness, impact, generalizability, and comparability are explored. (SLD)