It is common to find mixed-format data results from the use of both multiple-choice (MC) and constructed-response (CR) questions on assessments. Dealing with these mixed response types involves understanding what the assessment is measuring, and the use of suitable measurement models to estimate latent abilities. Past research in educational…

Purpose: In the early 1980s, researchers and speech-language pathologists (SLPs) collaborated to develop the Systematic Analysis of Language Transcripts (SALT). Research and development over the ensuing decades has culminated into SALT Solutions, a set of tools to assist SLPs to efficiently complete language sample analysis (LSA) with their…

Purpose: The purposes of this tutorial are (a) to describe a method of language sample analysis (LSA) referred to as SUGAR (Sampling Utterances and Grammatical Analysis Revised) and (b) to offer step-by-step instructions detailing how to collect, transcribe, analyze, and interpret the results of a SUGAR language sample. Method: The tutorial begins…

The argument-based approach to validity (Kane, 2013) focuses on two steps: (1) making claims about the proposed interpretation and use of test scores as a coherent, interpretive argument; and (2) evaluating those claims based on theoretical and empirical evidence related to test performances and scores. This paper discusses the role of…

Language sample analysis (LSA) is valuable clinical tool and an important component of comprehensive language assessment. However, LSA is underutilized in real-world practice. SLPs have identified time constraints, insufficient training, and lack of confidence in LSA skills as barriers to regular LSA implementation. Communication science and…

Accrediting agencies for English language programs, such as the Commission on English Language Program Accreditation (CEA), require a plan in writing for monitoring and reviewing assessment practices. Nonetheless, web-search queries such as "assessing assessment," "how to assess assessment," "assessing assessment…

Predicting student success in a data science degree program is a challenging task due to the interdisciplinary nature of the field, the diverse backgrounds of the students, and an incomplete understanding of the precise skills that are most critical to success. In this study, the applicant's future academic performance in a Master of Data Science…

Research involving digital games and language learning is rapidly growing. One advantage of using digital games to support language learning is the ability to collect data on students learning in real time. In this study, we use educational data mining methods to explore the relationship between in-game data and elementary students' Chinese…

This study examined the effectiveness of guided data-driven learning (DDL) activities on helping technological university students with a lower-intermediate proficiency level to learn grammar and vocabulary topics for the TOEIC test. The question of whether inductive learners make more progress than deductive learners was also addressed. A total…

Currently, much research on cognitive diagnostic assessment (CDA) focuses on the development of statistical models estimating individual students' attribute profiles. However, little is known about how to communicate model-generated statistical results to stakeholders, and how to translate formatively diagnostic information into teaching…

This is the first paper that provides correlational evidence about how interacting with an online allophonic transcription tool helps learners of English as a Second Language (ESL) to improve their phonological awareness. The study investigates 55 advanced ESL learners at a Polish university enrolled in a course in English phonetics and phonology.…

This study integrated the multimodal framework of learning analytics (IMFLA) with the concept mapping (Cmap) approach to improve students' vocabulary and reading abilities. A total of 70 participants were divided into 2 classes, Class 1 (experimental) and Class 2 (control), for a 1-year period. Vocabulary and reading tests were implemented 3…

Sparse-rated data are common in operational performance-based language tests, as an inevitable result of assigning examinee responses to a fraction of available raters. The current study investigates the precision of two generalizability-theory methods (i.e., the rating method and the subdividing method) specifically designed to accommodate the…

Recognizing that children's learning outcomes generally remain low, in its recent 2017--2021 Education and Skills Sector Plan (ESSP) the Government of Zambia prioritized improving learning outcomes through strategies that addressed gaps in education system quality, access, equity and efficiency. What resources and contextual factors are associated…

Educational systems typically contain a large pool of items (questions, problems). Using data mining techniques we can group these items into knowledge components, detect duplicated items and outliers, and identify missing items. To these ends, it is useful to analyze item similarities, which can be used as input to clustering or visualization…