Best linear prediction (BLP) and penalized best linear prediction (PBLP) are techniques for combining sources of information to produce task scores, section scores, and composite test scores. The report examines issues to consider in operational implementation of BLP and PBLP in testing programs administered by ETS [Educational Testing Service].

Many assessments of writing proficiency that aid in making high-stakes decisions consist of several essay tasks evaluated by a combination of human holistic scores and computer-generated scores for essay features such as the rate of grammatical errors per word. Under typical conditions, a summary writing score is provided by a linear combination…

A generic approach in automated essay scoring produces scores that have the same meaning across all prompts, existing or new, of a writing assessment. This is accomplished by using a single set of linguistic indicators (or features), a consistent way of combining and weighting these features into essay scores, and a focus on features that are not…

This report evaluates the construct coverage of the e-rater[R[ scoring engine. The matter of construct coverage depends on whether one defines writing skill, in terms of process or product. Originally, the e-rater engine consisted of a large set of components with a proven ability to predict human holistic scores. By organizing these capabilities…

Test disclosure legislation in New York State (LaValle Act) has had a major impact on the national testing programs administered by Educational Testing Services (ETS) for various sponsoring organizations. The paper reviews the immediate operational effects of test disclosure in the following areas: (1) increase in number of test forms developed;…

A report on tests used by California undergraduate institutions and by graduate and professional schools is presented by the California Postsecondary Education Commission. Information is provided on five tests used by undergraduate colleges: the Preliminary Scholastic Aptitude Test/National Merit Scholarship Qualifying Test, the Scholastic…

This paper discusses the relationship between language proficiency and intelligence. In particular, the paper is concerned with the elements of intelligence testing which creep into tests designed to determine language proficiency, and the proliferation of testing of all types and the kinds of interpretations made of these tests. Particular…

This study was designed to describe and analyze (1) the performance of foreign candidates taking the Graduate Management Admission Test (GMAT) or the Graduate Record Examinations (GRE) Aptitude Test in relation to self-reported primary language (English vs. other), and (2) relationships between performance on the respective admissions tests and…

This paper reports on Educational Testing Service research studies investigating the parameters critical to reliability and validity in both the direct and indirect writing ability assessment of higher education applicants. The studies involved: (1) formulating an operational definition of writing competence; (2) designing and pretesting writing…

A comprehensive review was conducted of writing research literature and writing test program activities in a number of testing programs. The review was limited to writing assessments used for admission in higher education. Programs reviewed included ACT, Inc.'s ACT™ program, the California State Universities and Colleges (CSUC) testing program,…