Development of reliable rubrics for educational intervention studies that address reading and writing skills is labor-intensive, and could benefit from an automated approach. We compare a main ideas rubric used in a successful writing intervention study to a highly reliable wise-crowd content assessment method developed to evaluate…

The history of vocabulary research has specified a rich and complex construct, resulting in calls for vocabulary research, assessment, and instruction to take into account the complex problem space of vocabulary. At the intersection of vocabulary theory and assessment modeling, this paper suggests a suite of modeling techniques that model the…

In this article, we present the results of three question design experiments on inter-item correlations, which tested a grid design against a single-item design. The first and second experiments examined the inter-item correlations of a set with five and seven items, respectively, and the third experiment examined the impact of the question design…

Information is generally more memorable after it is studied and tested than when it is only studied. One must be cautious to use this phenomenon strategically, however, due to uncertainty about whether testing improves memorability for only tested material, facilitates learning of related non-tested content, or inhibits memory of non-tested…

In the recent years in the End-User Development (EUD) research there is a shift from the study of tools that focus on desktop graphical applications, to the development of EUD for web environments. Human-Computer Interaction (HCI) research has shown significant gender differences while users interact with EUD systems. However, most of this…

The history of vocabulary research has specified a rich and complex construct, resulting in calls for vocabulary research, assessment, and instruction to take into account the complex problem space of vocabulary. At the intersection of vocabulary theory and assessment modeling, this paper suggests a suite of modeling techniques that model the…

Writing and communication skills are important in all fields of employment. During the course of everyday life, people have to perform tasks they have never done before, or learn a technology they have never used. Most tasks are processes, and it takes some time to learn how they work. Instructions are the most common method of explaining how to…

This article reports on the implementation of formative e-assessments in courses taken by first-year students. The central aim is to measure the effectiveness of the formative e-assessments with reference to the student voice and staff reflections. Students engaged with the formative assessments and the evidence gathered via questionnaires show…

This study examined information integration cognitive mechanisms underlying the test anxiety judgments of 474 engineering students. The experimental design considered the orthogonal combination of three factors (teaching style, exam type, and test mode), resulting in 12 experimental scenarios. During the experiments, participants were provided one…

The TOEFL iBT test was introduced in 2005 to better reflect the language demands of real-life academic tasks than did previous versions of the test. The task-based design of the test was intended to support the interpretation of its scores as a trustworthy measure of international students' ability to use English in an academic environment. Until…

This study explored the cognitive mechanism behind information integration in the test anxiety judgments in 140 engineering students. An experiment was designed to test four factors combined (test goal orientation, test cognitive functioning level, test difficulty and test mode). The experimental task required participants to read 36 scenarios,…

Computer-based testing (CBT), which refers to delivering assessments with computers, has been widely used in large English proficiency tests worldwide. Despite an increasing CBT in China, limited research is available concerning whether CBT can be used for the Test for English Majors-Band 4 (TEM 4). The current study investigated whether testing…

The COVID-19 pandemic caused nearly all colleges and universities to transition in-person courses to an online format. In this study, we explored how the rapid transition to online instruction during the COVID-19 pandemic affected students with disabilities. We interviewed 66 science, technology, engineering, and math (STEM) undergraduates with…

The COVID-19 epidemic, which deeply affected educational practices all over the world, caused significant difficulties in the process of effective evaluation of students with the suspension of face-to-face education. This research deals with the assessment-evaluation methods applied by science and physics teachers in the online education process…

This study utilized Automated Speech Recognition technology to determine the potential utility and acceptance of such technology in the English as a Foreign Language classroom. Learners were made aware of the Automatic Speech Recognition potential of their mobile devices and provided with some direction in, and incentive for, its use. Participants…