This study explores classification consistency and accuracy for mixed-format tests using real and simulated data. In particular, the current study compares six methods of estimating classification consistency and accuracy for seven mixed-format tests. The relative performance of the estimation methods is evaluated using simulated data. Study…

Although much research has been conducted on the psychometric properties of cognitive diagnostic models, they are only recently being used in operational settings to provide results to examinees and other stakeholders. Using this newer class of models in practice comes with a fresh challenge for diagnostic assessment developers: effectively…

When exposed to principal components analysis for the first time, students can sometimes miss the primary purpose of the analysis. Often the focus is solely on data reduction and what to do after the dimensions of the data have been reduced is ignored. The datasets discussed here can be used as an in-class example, a homework assignment, or a…

In the past decades, there has been a surge in interest in the study of language complexity in second language (L2) research. In this article we provide an overview of current theoretical and methodological practices in L2 complexity research, while simultaneously framing these within the broader scientific interest into the notion of complexity.…

This paper discusses a poetry translation, Love & Misadventure by Lang Leav into Indonesian translated by Aan Mansyur. The purpose of this study is to determine how the translator considers the translation techniques used to translate the poem into the target language and its impact of the translation quality in terms of accuracy and…

With the spread of the COVID-19 pandemic, many universities adopted a hybrid learning model as a substitute for a traditional one. Predicting students' performance in hybrid environments is a complex task because it depends on extracting and analyzing different types of data: log data, self-reports, and face-to-face interactions. Students must…

The number of English learners (ELs) who do not reclassify as English proficient after the first five years of schooling has increased across the state of Texas. ELs are a diverse population of students with varying levels of English proficiency. Many students who begin school as an EL reclassify as English proficient in a timely manner and go on…

Purpose: The clinical diagnosis of motor speech disorders (MSDs) is mainly based on perceptual approaches. However, studies on perceptual classification of MSDs often indicate low classification accuracy. The aim of this study was to determine in a forced-choice dichotomous decision-making task (a) how accuracy of speech-language pathologists…

We re-examine a Malawian teacher's lessons which, using the framework of mathematic problem-solving developed by Polya, the typology of levels of task demand from Stein and colleagues and Malawi's description of learner-centred education (LCE), were described as teacher-centred and evaluated as 'not good'. We studied seven video-recorded circle…

Proportional reasoning is a key topic both at school and in everyday life. However, students are often misled by their preconceptions regarding proportions. Our hypothesis is that these limitations can be mitigated by working on alternative ways of categorizing situations that enable more adequate inferences. Multiple categorization triggers…

The purpose of this study is to identify a typology of school organizational capacities using teachers' perceptions of school organizational context. Employing a sample of New York City schools serving students in grades 3-8 (n = 1,289), we perform a 3-step latent class analysis (LCA). We identify six subgroups of schools: "versatile…

Though understudied, academic structure reflects and shapes the central work--education, research, service--of higher education organizations (HEOs). Academic structure also shapes and illuminates the external environments and internal dynamics of HEOs. Despite the centrality of academic structure to HEOs and their work, our knowledge of it is…

The purpose of this review is to examine the effects of automated writing evaluation (AWE) feedback on students' English writing performance. We systematically reviewed studies that have empirically focused on this purpose. This review uses several combinations of key words to search in the databases of JSTOR, SSCI, and ERIC for peer-reviewed…

This paper looks into the dilemma of what counts as a grammatical 'learner error' in ELT on the basis of recent results from English variationist research and English as a lingua franca research. Examples from these studies show that features often perceived as 'errors' for EFL speakers also occur in ESL production--where they are called…

Purpose: This paper aims to introduce the extended qualitative content analysis (EQCA) method to integrate data-reducing and data-complicating research steps when conducting qualitative research on the United Nations and other international institutions. Design/methodology/approach: EQCA supplements the method of qualitative content analysis,…