Despite calls for engaging assessments targeting young language learners (YLLs) between 8 and 13 years old, what makes assessment tasks engaging and how such task characteristics affect measurement quality have not been well studied empirically. Furthermore, there has been a dearth of validity research about technology-enhanced speaking tests for…

This study explored the relationships among language proficiency, two selected test-taker characteristics (i.e., topical knowledge and anxiety), and integrated speaking test performance. Data collection capitalized on three sets of instruments: three integrated tasks derived from TOEFL-iBT preparation materials, the state anxiety inventory created…

The purpose of this study was to replicate the structure of mental speed and relations evidenced with fluid intelligence (Gf) found in a number of recent studies. Specifically, a battery of computerized tasks examined whether results with paper-and-pencil assessments held across different test media. Participants (N = 186) completed the battery,…

Speech acts are the major concern of interlanguage pragmatists. The present study aimed to 1) examine the reliability and validity of an interlanguage pragmatic (ILP) competence test on speech acts in a Chinese EFL context, and 2) investigate EFL learners' variations of ILP competence by language proficiency. Altogether 390 students participated…

In this article, we highlight the need for a precisely defined construct in score-based validation and discuss the contribution of cognitive theories to accurately and comprehensively defining the construct. We propose a framework for integrating cognitively based theoretical and empirical evidence to specify and evaluate the construct. We apply…

Significant momentum exists for next-generation assessments to increasingly utilize technology to develop and deliver performance-based assessments. Many traditional challenges with this assessment approach still apply, including psychometric concerns related to performance-based tasks (PBTs), which include low reliability, efficiency of…

This paper presents an initial test of the group task demands-resources (GTD-R) model of group task performance among IT students. We theorize that demands and resources in group work influence formation of perceived group work pressure (GWP) and that heightened levels of GWP inhibit group task performance. A prior study identified 11 factors…

A procedure for using Guilford's structure of the intellect as the theoretical basis for a task analysis model is presented. It is reasoned that such a model would furnish a bridge between task analysis and test selection, and also a bridge between test selection and test validation. Such a mechanism might answer some fo the EEOC criticisms of…

A procedure for using Guilford's structure of the intellect as the theoretical basis for a task analysis model is presented. It is reasoned that such a model would furnish a bridge between task analysis and test selection, and also a bridge between test selection and test validation. Such a mechanism might answer some of the Equal Employment…

Fifty-five recent studies of individual differences (IDs) in elementary cognitive tasks (ECTs) are reviewed. Twenty-five data sets are examined, analyzed, or reanalyzed by factor analysis. The following promising dimensions are identified: basic perceptual processes, reaction and movement times, mental comparison and recognition tasks, retrieval…

A Paradigm for testing concept attainment, comprised of twelve tasks, was formulated. These tasks were hypothesized to form a cumulative hierarchy. Tests were constructed in mathematics and social studies using the paradigm. Data for these tests was analyzed by Kaiser's method for fitting a perfect simplex and Schonemann's method for fitting a…

The Wisconsin Design for Reading Skill Development is a vehicle for implementing a skills-centered approach to reading instruction. The components of the design are (1) management guidelines; (2) an essential skills list for six areas (word attack, comprehension, study skills, self-directed reading, interpretive reading, and creative reading) and…

The validity and use of the Differential Diagnosis-Prescriptive Teaching Model in special education is challenged. A review of research related to six assumptions underlying the model is presented. It is concluded that children do not appear to benefit from current applications of this instructional method. (MH)

This volume contains the initial draft of a model for assessing students in vocational education programs in Georgia. Addressed in the first section of the draft are some of the components that are believed to be critical in the development of a model for assessing vocational student achievement, including selecting a program for use in developing…