Synthetically generated speech (SGS) has become an integral part of our oral communication in a wide variety of contexts. It can be generated instantly at a low cost and allows precise control over multiple aspects of output, all of which can be highly appealing to second language (L2) assessment developers who have traditionally relied upon human…

Unlike the traditional multiple-choice (MC) format, the discrete-option multiple-choice (DOMC) format does not necessarily reveal all answer options to an examinee. The purpose of this study was to determine whether the reduced exposure of item content affects test security. We conducted an experiment in which participants were allowed to view…

The aim of this study is to investigate the end-of-unit evaluation questions in 5th grade primary school science workbook according to dimensions of the Revised Bloom's Taxonomy (RBT). For that purpose, 191 end-of-unit evaluation questions of 5th grade science workbook which is approved by the Republic of Turkey -the Ministry of National…

Administering exams in large enrollment courses is challenging and systems in place for accomplishing this task were upended in the spring of 2020 when a sudden transformation to online instruction and testing occurred due to the COVID-19 pandemic. In the following year, when courses remained online, approaches to improve exam security included…

This research examined the Chinese National College Entrance Examination (NCEE) in mathematics before and after the Great Proletarian Cultural Revolution, specifically covering the periods 1952-1965 and 1977-1984. The central focus was on the organization, structure, and content of the examinations, as well as their influence on and interaction…

The Progress in International Reading Literacy Study (PIRLS) has been monitoring international trends in reading achievement among fourth-grade students for 25 years. As a critical point in a student's education, the fourth year of schooling establishes the foundations of literacy, with reading becoming increasingly central to learning across all…

This three-manuscript dissertation attempts to answer the question: "How does students' English language proficiency (ELP) inform the availability, structure, and use of English language accommodations and intervention to support the academic achievement of English learner (EL) students?" The question is addressed using three independent…

Teamwork skills are foundational for career success and student learning in group projects. One of the major challenges of teamwork involves managing conflict among team members. In the current research, we develop a conflict management styles (CMS) psychometric inventory that assesses students' levels of the five styles of managing conflict based…

This study aimed to develop a Vietnamese word recognition test for Taiwanese undergraduate students and to investigate students' performances at different learning stages. The formal test consists of 100 words as test items. With each word, test takers were asked to select the correct Vietnamese word form corresponding to the pronunciation they…

This study set out to develop a short interest inventory based on Holland's model of vocational personality types using items from the South African Career Interest Inventory (SACII). In study 1, we used 1000 responses to the SACII from an existing database to select 30 items for this interest inventory. Satisfactory reliability and structural…

Web, or online, probing has the potential to supplement existing questionnaire design processes by providing structured cognitive data on a wider sample than typical qualitative-only question evaluation methods can achieve. One of the practical impediments to the further integration of web probing is the concern of survey managers about how the…

Calibration of an item bank for computer adaptive testing requires substantial resources. In this study, we investigated whether the efficiency of calibration under the Rasch model could be enhanced by improving the match between item difficulty and student ability. We introduced targeted multistage calibration designs, a design type that…

A key challenge in the design of effective survey questionnaires is to write questions that respondents can understand consistently. Recommendations in the questionnaire design literature propose the use of respondents' own terminology to facilitate comprehension and the response process. In this article, we propose an innovative questionnaire…

Tests administered in studies of student achievement often have a certain amount of not-reached items (NRIs). The propensity for NRIs may depend on the proficiency measured by the test and on additional covariates. This article proposes a semiparametric model to study such relationships. Our model extends Glas and Pimentel's item response theory…

In 2013, the Council of Chief State School Officers (CCSSO), working collaboratively with state education agencies, released a set of criteria for states to use to evaluate and procure high-quality assessments. The mathematics section of the document included five content-specific criteria to evaluate alignment of assessments to college- and…