This paper is the first in a series from Educational Testing Service (ETS) concerning English language proficiency (ELP) assessments for K-12 English learners (ELs). The goal of this paper, and the series, is to present research-based ideas, principles, and recommendations for consideration by those who are conceptualizing, developing, and…

In today's item response theory (IRT) the response to the test item is considered as a probability event depending on the student's ability and difficulty of items. It is noted that in the scientific literature there is very little agreement about how to determine factors affecting the item difficulty. It is suggested that the difficulty of the…

Background: Women in mathematical domains may become attuned to situational cues that signal a discredited social identity, contributing to their lower achievement and underrepresentation. Aim: This study examined whether heightened in-group representation alleviates the effects of stereotype threat on women's mathematical performance. It further…

Previous research has documented the role of readers' existing topic knowledge in supporting students' comprehension of text; yet, we know less about how to build students' knowledge in order to support comprehension and vocabulary learning. In the current study, we test the hypothesis that knowledge can be built and leveraged simultaneously in…

This paper explores the trend, between 1905 and the late 1920s in UK and US child psychology, of "discovering," labelling and calculating different "ages" in children. Those new "ages"--from mental to emotional, social, anatomical ages, and more--were understood as either replacing, or meaningfully related to,…

Item analysis of Multiple Choice Questions (MCQs) is the process of collecting, summarizing and utilizing information from students' responses to evaluate the quality of test items. Difficulty Index (p-value), Discrimination Index (DI) and Distractor Efficiency (DE) are the parameters which help to evaluate the quality of MCQs used in an…

Introduction: Under the influence of Vygotsky, dynamic assessment (DA) has recently crept into the realm of L2 testing to assess learners' cognitive modification through the concept of mediation and zone of proximal development (ZPD) (Ableeva, The Effects of Dynamic Assessment on L2 Listening Comprehension 2008; Lantolf, Sociocultural theory and…

In education research and in many other fields, researchers are often interested in testing the effectiveness of an intervention on multiple outcomes, for multiple subgroups, at multiple points in time, or across multiple treatment groups. The resulting multiplicity of statistical hypothesis tests can lead to spurious findings of effects. Multiple…

As the American workforce and workplace become more diverse, the need for skilled leaders who are culturally intelligent and able to maximize diversity has become crucial. The purpose of this exploratory sequential mixed methods research study was to identify patterns of Self-Directed Learning (SDL) that were found in a sample also assessed on…

Divergent thinking (DT) tests are the most frequently used types of creativity assessment and have been administered in traditional paper and pencil format for more than a half century. With the prevalence of computer-based testing and increasing demands for large-scale, faster, and more flexible testing procedures, it is necessary to explore and…

This study reports data on a case study which is really four individual but related studies which used the same data set. Data included U.S. national rankings published annually by "U.S. News and World Report" which rate universities and their respective departments. It also used a relatively new metric called the h-index which is…

Cognitive diagnostic computerized adaptive testing (CD-CAT) purports to combine the strengths of both CAT and cognitive diagnosis. Cognitive diagnosis models aim at classifying examinees into the correct mastery profile group so as to pinpoint the strengths and weakness of each examinee whereas CAT algorithms choose items to determine those…

The computer-adaptive multistage testing (ca-MST) has been developed as an alternative to computerized adaptive testing (CAT), and been increasingly adopted in large-scale assessments. Current research and practice only focus on ca-MST panels for credentialing purposes. The ca-MST test mode, therefore, is designed to gauge a single scale. The…

When a constructed-response test form is reused, raw scores from the two administrations of the form may not be comparable. The solution to this problem requires a rescoring, at the current administration, of examinee responses from the previous administration. The scores from this "rescoring" can be used as an anchor for equating. In…

This study investigated the dimensionality of the physical literacy environment of early childhood education classrooms. Data on the classroom physical literacy environment were collected from 245 classrooms using the Classroom Literacy Observation Profile. A combination of confirmatory and exploratory factor analysis was used to identify five…