In cognitive diagnostic assessment, multiple fine-grained attributes are measured simultaneously. Attribute hierarchies are considered important structural features of cognitive diagnostic models (CDMs) that provide useful information about the nature of attributes. Templin and Bradshaw first introduced a hierarchical diagnostic classification…

It is common practice for assessment programs to organize qualifying sessions during which the raters (often known as "markers" or "judges") demonstrate their consistency before operational rating commences. Because of the high-stakes nature of many rating activities, the research community tends to continuously explore new…

Norm-referenced error analysis is useful for understanding individual differences in students' academic skill development and for identifying areas of skill strength and weakness. The purpose of the present study was to identify underlying connections between error categories across five language and math subtests of the Kaufman Test of…

This paper presents an approach to standard setting that combines the prototype group method (PGM; Eckes, 2012) with a receiver operating characteristic (ROC) analysis. The combined PGM-ROC approach is applied to setting cut scores on a placement test of English as a foreign language (EFL). To implement the PGM, experts first named learners whom…

Cognitive diagnostic models (CDMs) have great promise for providing diagnostic information to aid learning and instruction, and a large number of CDMs have been proposed. However, the assumptions and performances of different CDMs and their applications in regard to reading comprehension tests are not fully understood. In the present study, we…

In response to a request for additional analyses, in particular reporting confidence intervals around the results, we re-analyzed the data from prior studies. This supplementary report presents the results of the additional analyses addressing classification accuracy, reliability, and criterion-related validity evidence. For ease of reference, we…

In response to a request for additional analyses, in particular reporting confidence intervals around the results, we re-analyzed the data from prior studies. This supplementary report presents the results of the additional analyses addressing classification accuracy, reliability, and criterion-related validity evidence. For ease of reference, we…

Despite federal and state laws and regulations that require states and local districts to provide English language learners (ELLs) with support services, prior research has indicated that ELLs are, in general, lagging behind non-ELLs in academic achievement. An unanswered question is whether the initial designation of students as ELL influences…

This study investigates the referential choice of Mandarin-speaking children with autism spectrum disorder (ASD). The data consist of narratives from 16 children with ASD and 16 typically-developing (TD) children. The narratives were elicited using the wordless picture book "Frog, where are you?" Participants' referential expressions…

This quantitative study focuses on the relationship between foreign language learners' aptitude and proficiency test scores. Four groups of 136 beginning students received six months of Initial Acquisition Training (IAT) in four different language categories, according to the level of complexity for an English speaker: French (Category I),…

By means of a large-scale web-based investigation, we established the degree of mutual intelligibility of 16 closely related spoken languages within the Germanic, Slavic and Romance language families in Europe. We first present the results of a selection of 1833 listeners representing the mutual intelligibility between young, educated Europeans…

The current study aimed at investigating the status of Professional Development (PD) through examining teachers' perspectives over how effective they consider exam specific teacher training courses (IELTS in this case) which aim at increasing their PD. To this end, a group of EFL teachers, from different language schools in Mashhad, Iran took part…

In English, positions of lexical stress in disyllabic words are associated with word categories; that is, nouns tend to be stressed more often on the first syllable, whereas verbs are more likely to be stressed on the second syllable (i.e. "sub"ject (noun) vs. sub"ject" (verb)). This phenomenon, which is called the stress…

This study focuses on metalinguistic awareness (MLA) and its relation to academic achievement for mono-, bi- and multilingual adolescents in Denmark. While MLA is one of several cognitive measures positively related to bilingualism and bilingualism is associated with academic advantages, Danish bi-/multilingual pupils appear not to benefit from…

The purpose of this study was to enhance the meaning of the scores of an English-language test by developing performance levels and descriptors for reporting overall test performance. The levels and descriptors were intended to accompany the total scale scores of TOEFL Junior® Standard, an international test of English as a second/foreign…