With the continuous development of education, personalized learning has attracted great attention. How to evaluate students' learning effects has become increasingly important. In information technology courses, the traditional academic evaluation focuses on the student's learning outcomes, such as "scores" or "right/wrong,"…

This study aims to provide a deeper understanding about the Bebras tasks, which is one of the computational thinking (CT) unplugged activities, in terms of age level, task category, and CT skills. Explanatory sequential mixed method was adopted in the study in order to collect data according to the research questions. The participants of the study…

This study investigates how different form-focused instruction (FFI) timing impacts English as a foreign language (EFL) learners' grammar development. A total of 169 Chinese middle school learners were assigned to four conditions randomly: control, before-isolated FFI, integrated FFI, and after-isolated FFI. The three experimental groups received…

Distractors in tests are included to divert attention away from correct answers choices. Knowing what types of distractors commonly appear in tests will benefit test takers as they can prepare themselves beforehand. Therefore, this qualitative study was aimed at making assumptions on plausible lexical distractors which are expected to appear in…

In cognitive diagnosis assessment (CDA), the impact of misspecified item-attribute relations (or "Q-matrix") designed by subject-matter experts has been a great challenge to real-world applications. This study examined parameter estimation of the CDA with the expert-designed Q-matrix and two refined Q-matrices for international…

VocQGen is an automated tool designed to generate multiple-choice cloze (MCC) questions for vocabulary assessment in second language learning contexts. It leverages several natural language processing (NLP) tools and OpenAI's GPT-4 model to produce MCC items quickly from user-specified word lists. To evaluate its effectiveness, we used the first…

The purpose of this research is to develop test questions of problem solving ability on work-energy material for high school students class X. This type of research is research and development. The model used in this study is ADDIE with the stages of analyzing, planning, developing, implementing, and evaluating, but this study only up to the…

Technological literacy (TL) as the goal of technology education guides the construction of the technology education curriculum in China. Previous studies investigating technological literacy were limited to K-12 students and had some ambiguities in the definition of technology, theoretical framework, and assessed criterion, and a measurement…

The Civil War was concluded over 150 years ago but recently, monuments erected to commemorate the Civil War and its participants have been the site of civil unrest (e.g., Charlottesville, VA in 2018) and calls for removal of such monuments. The Confederate monuments debate has been going strong for decades, and it seems to have been picking up…

The design and psychometric methodology of the National Assessment of Educational Progress (NAEP) is constantly evolving to meet the changing interests and demands stemming from a rapidly shifting educational landscape. NAEP has been built on strong research foundations that include conducting extensive evaluations and comparisons before new…

The evidence is mounting regarding the guidance to employ more three-option multiple-choice items. From theoretical analyses, empirical results, and practical considerations, such items are of equal or higher quality than four- or five-option items, and more items can be administered to improve content coverage. This study looks at 58 tests,…

The Bruininks-Oseretsky Test of Motor Proficiency -- Second Edition (BOT-2) is a commonly used assessment of children's skills. It is important that assessments have validity evidence reported about them. The objective of the study was to investigate the structural validity of the BOT-2's eight subscales and four composite scales. A sample of 117…

When using the Rasch model, equating with a nonequivalent groups anchor test design is commonly achieved by adjustment of new form item difficulty using an additive equating constant. Using simulated 5-year data, this report compares 4 approaches to calculating the equating constants and the subsequent impact on equating results. The 4 approaches…

This article describes how with the advent of computer-based technology, there is movement from manual to automated systems for different aspects of the education system. Testing is an essential part of teaching process that helps academics in classifying the level of students and evaluating the outcomes of their teaching process. The testing…

The usefulness of item response theory (IRT) models depends, in large part, on the accuracy of item and person parameter estimates. For the standard 3 parameter logistic model, for example, these parameters include the item parameters of difficulty, discrimination, and pseudo-chance, as well as the person ability parameter. Several factors impact…