Although most international students arrive with required language qualifications, many struggle with the linguistic demands of their programmes. This study explored whether the test-preparation industry undermines the qualifications with which students arrive. English proficiency of 153 Chinese student in the UK was tested on the Duolingo English…

Subscores, also known as domain scores, diagnostic scores, or trait scores, can help determine test-takers' relative strengths and weaknesses and appropriately focus remediation. However, subscores often have poor psychometric properties, particularly reliability and distinctiveness (Folske, Gessaroli, & Swanson, 1999; Monaghan, 2006;…

Language test preparation has often been studied within the consequential validity framework in relation to ethics, equity, fairness, and washback of assessment. The use of independent and integrated speaking tasks in the "TOEFL iBT"® test represents a significant development and innovation in assessing speaking ability in academic…

Simultaneous with a call for standardized assessments to assess developing rather than preexisting or surface knowledge (Sawyer, 2006) has been a growth in awareness of the unavoidable interactive nature of any form of assessment and this awareness has created a social turn towards approaches to language assessment (McNamara & Roever, 2006).…

Emrick's proposed method for determining a mastery level cut-off score is questioned. Emrick's method is shown to be useful only in limited situations. (JKS)

The purpose of this study was to determine whether option weighting improved the internal consistency and intercorrelation of the subtests. The differential option-weighting scheme employed in this study is based on one devised by Guttman. The tests were first scored with Guttman-type weights and then with conventional correction-for-guessing…

Because test scores are ordinal not cordinal attributes, the average test score often is a misleading way to summarize the scores of a group of individuals. Similarly, correlation coefficients may be misleading summary measures of association between test scores. Proper, readily interpretable, summary statistics are developed from a theory of…

Samples in research on individual and group differences may be selected based on whole scores which differ from the population mean. Children are diagnosed in clinical practice with a whole score. These procedures produce regression to the population mean which can affect accuracy and adequacy of part score interpretations. (Author/DWH)

For the six available sets of empirical data, the discrimination (slope) parameter of the logistic item characteristic curve was found to have a significant positive correlation over items with the difficulty (location) parameter. This unpleasant situation can be eliminated by a suitably chosen transformation of the ability scale. (Author/RC)

Forming a sequence covering the various aspects of the simplex model, four articles are presented here under the following titles: "A Simplex Model for Analyzing Academic Growth", "Analyzing Ratings With Correlated Intrajudge Measurement Errors", "The Correlation of States With Gain", and "The Reliability of…

Estimation techniques for generating the covariance matrix for two new tests and an existing test without the necessity of any examinee having to take two complete tests is presented. An application of these techniques to linear, observed-score, test equating is presented. (Author/JKS)

An important determinant of equating process efficiency is the correlation between the anchor test and components of each form. Use of some monotonic function of this correlation as a measure of equating efficiency is suggested. A model relating anchor test length and test reliability to this measure of efficiency is presented. (Author/DWH)

There is no one structural model that defines the construct functional literacy. However, acceptable construct definitions in the literature cumulatively form some beginnings for a nomological network that relates functional literacy to the level of skills deemed necessary for survival in society. In the study, two different validation…

Factor analysis is the traditional method for studying the dimensionality of test data. However, under common conditions, the factor analysis of tetrachoric correlations does not recover the underlying structure of dichotomous data. The purpose of this paper is to demonstrate that the factor analyses of tetrachoric correlations is unlikely to…

The purpose of this study was to examine the stability of measures of student writing performance across types of discourse (genres) and across response modes (selected response: multiple choice; constructed response: single paragraph, and full length essay). The study addressed the following: (1) the relationship/stability of writing scores…