Assessment and institutional research offices have too much data and too little time. Standard reporting often crowds out opportunities for innovative research. Fortunately, advancements in data science now offer a clear solution. It is equal parts technique and philosophy. The first and easiest step is to modernize data work. This column…

Q methodology (Q) offers a scientific way to study subjectivity, meaning people's viewpoints about a topic. The underlying assumption of Q is that when people share an experience, they do not necessarily form the same viewpoint about that experience. This is different from the use of Likert-scale surveys that report results using aggregate…

Flipped blended learning (FBL) has become popular in translator training, requiring teachers to adapt their beliefs and attitudes towards blended learning to design and implement professional training programmes. This study investigates the effects of FBL on competence improvement in translation technology education. Using an action research…

The integration of generative artificial intelligence (GenAI) into web-based individual formative e-assessments in higher education is a nascent field that warrants further exploration. This study investigated the use of GenAI within an 8-week undergraduate-level research methods course at a university in the United States of America, aiming to…

The University English Centres of Australia (UECA) 'Assessment Symposium: Assessment Practice in a Changing World' at Southern Cross University in October 2022 highlighted the growing interest in integrated assessment in Australian university direct entry programs (DEPs) for English as Additional Language (EAL) students. In keynote presentations,…

This article reviews a selected sample of 70 empirical studies in journal articles and doctoral dissertations on language assessment in China between 2011 and 2018. Following a brief introduction to the history and current state of language assessment in China, the article presents a critical review of language assessment research on six themes…

Purpose: With improvements in computer technologies and test implementations in the computer environment, when advantageous points of computer-based test implementations are considered, it is inevitable to compare psychometric characteristics of paper-and-pencil tests and computer-based tests and students' success. In computer-based tests,…

This article summarizes the methods, observations, challenges and implications for exploratory analysis drawn from two learning analytics research projects. The cases include an analysis of a games-based virtual performance assessment and an analysis of data from 52,000 students over a 5-year period at a large Australian university. The complex…

With the research reported here, we specifically aim to develop application products of scientific work independence instruments through science integrated learning (SIL) for various education levels (elementary schools, junior high schools, senior high schools, and universities). The SIL model was applied in learning to determine specific…

The advent of artificial intelligence (AI), particularly large language models (LLMs) like ChatGPT and Gemini, has significantly impacted the educational landscape, offering unique opportunities for learning and assessment. In the realm of written assessment grading, traditionally viewed as a laborious and subjective process, this study sought to…

Objectives: Volunteering promotes well-being and may provide added purpose to life after retirement. Limited evidence exists regarding the characteristics and study adherence among those who participate in longitudinal studies while also volunteering outside the study. We assessed characteristics and adherence of older adults who volunteered…

Category learning is fundamental to cognition, but little is known about how it proceeds in real-world environments when learners do not have instructions to search for category-relevant information, do not make overt category decisions, and do not experience direct feedback. Prior research demonstrates that listeners can acquire task-irrelevant…

Over the past several years, content experts, psychometricians, and researchers have been hard at work developing, refining, and studying the digital SAT. The work is grounded in foundational best practices and advances in measurement and assessment design, with fairness for students informing all of the work done. This paper shares learnings from…

Between 2002 and 2014, the Institute of Education Sciences (Institute) supported over 400 projects focused on education technology through the National Center for Education Research (NCER) and the National Center for Special Education Research (NCSER). The majority of this work has been funded through Education Technology research topics of NCER…

The Teaching Resources Center (TRC) was developed at the university as an integrated project funded by the Ministry of Education. The focus of the TRC is not only on enhancing students' motivation in self-access study and written English, but also on providing the resources for research and information to develop lifelong learners and independent…