It is common to find mixed-format data results from the use of both multiple-choice (MC) and constructed-response (CR) questions on assessments. Dealing with these mixed response types involves understanding what the assessment is measuring, and the use of suitable measurement models to estimate latent abilities. Past research in educational…

Purpose: In the early 1980s, researchers and speech-language pathologists (SLPs) collaborated to develop the Systematic Analysis of Language Transcripts (SALT). Research and development over the ensuing decades has culminated into SALT Solutions, a set of tools to assist SLPs to efficiently complete language sample analysis (LSA) with their…

Purpose: The purposes of this tutorial are (a) to describe a method of language sample analysis (LSA) referred to as SUGAR (Sampling Utterances and Grammatical Analysis Revised) and (b) to offer step-by-step instructions detailing how to collect, transcribe, analyze, and interpret the results of a SUGAR language sample. Method: The tutorial begins…

The argument-based approach to validity (Kane, 2013) focuses on two steps: (1) making claims about the proposed interpretation and use of test scores as a coherent, interpretive argument; and (2) evaluating those claims based on theoretical and empirical evidence related to test performances and scores. This paper discusses the role of…

Language sample analysis (LSA) is valuable clinical tool and an important component of comprehensive language assessment. However, LSA is underutilized in real-world practice. SLPs have identified time constraints, insufficient training, and lack of confidence in LSA skills as barriers to regular LSA implementation. Communication science and…

Accrediting agencies for English language programs, such as the Commission on English Language Program Accreditation (CEA), require a plan in writing for monitoring and reviewing assessment practices. Nonetheless, web-search queries such as "assessing assessment," "how to assess assessment," "assessing assessment…

Research involving digital games and language learning is rapidly growing. One advantage of using digital games to support language learning is the ability to collect data on students learning in real time. In this study, we use educational data mining methods to explore the relationship between in-game data and elementary students' Chinese…

This study examined the effectiveness of guided data-driven learning (DDL) activities on helping technological university students with a lower-intermediate proficiency level to learn grammar and vocabulary topics for the TOEIC test. The question of whether inductive learners make more progress than deductive learners was also addressed. A total…

Currently, much research on cognitive diagnostic assessment (CDA) focuses on the development of statistical models estimating individual students' attribute profiles. However, little is known about how to communicate model-generated statistical results to stakeholders, and how to translate formatively diagnostic information into teaching…

This is the first paper that provides correlational evidence about how interacting with an online allophonic transcription tool helps learners of English as a Second Language (ESL) to improve their phonological awareness. The study investigates 55 advanced ESL learners at a Polish university enrolled in a course in English phonetics and phonology.…

This study integrated the multimodal framework of learning analytics (IMFLA) with the concept mapping (Cmap) approach to improve students' vocabulary and reading abilities. A total of 70 participants were divided into 2 classes, Class 1 (experimental) and Class 2 (control), for a 1-year period. Vocabulary and reading tests were implemented 3…

Sparse-rated data are common in operational performance-based language tests, as an inevitable result of assigning examinee responses to a fraction of available raters. The current study investigates the precision of two generalizability-theory methods (i.e., the rating method and the subdividing method) specifically designed to accommodate the…

The last decade has witnessed a strong impact of emerging technologies on language pedagogy due to the developments in the computer technologies. The use of authentic linguistic examples through corpora and concordance based activities is defined as data-driven learning and it exposes the students to examples of more realistic language than…

Interest in the effect of positive and negative emotions in foreign language acquisition has soared recently because of the positive psychology movement (Dewaele & MacIntyre, 2014, 2016; MacIntyre, Gregersen & Mercer, 2016). No work so far has been carried out on the differential effect of positive and negative emotions on foreign language…

In response to the need for examples of test validation from which everyday language programs can benefit, this paper reports on a study that used Bachman's (2005) assessment use argument (AUA) framework to examine evidence to support claims made about the intended interpretations and uses of scores based on a new web-based Spanish language…