The extensive use of automated speech scoring in large-scale speaking assessment can be revolutionary not only to test design and rating, but also to the learning and instruction of speaking based on how students and teachers perceive and react to this technology. However, its washback remained underexplored. This mixed-method study aimed to…

Literature review shows that the development process of an achievement test is mainly investigated in dissertations. Moreover, preparing a form that will shed light on developing an achievement test is expected to guide those who will administer the test. In this line, the current study aims to create an "Achievement Test Development Process…

Integrating educational assessment tools, such as the Motivated Strategies for Learning Questionnaire (MSLQ), into university classrooms can help students and faculty gain insight into areas of strength and challenge for students. The present study adapted and integrated the MSLQ into a set of first-year communication courses for Faculty of Arts…

The aim of this research is to develop a reliable and valid scale to determine the mathematical thinking skills of gifted students. In addition, with the developed scale, thinking skills of gifted students was examined in terms of various variables. In this context, the research was carried out on two different study groups. The first stage of…

This article compares Spanish proficiency assessments across three states (Texas, Arizona, and California) in relation to four overarching themes: (a) verification methods of proficiency; (b) test-task authenticity; (c) impact of pedagogical content knowledge in test performance; and (d) conceptions of language 'correctness' on the scoring…

A direct test of English speaking is important to evaluate what learners can do in real-life situations. However, due to challenges in test administration, especially with a large number of test-takers, a direct speaking test may not be feasible in many contexts and thus indirect tests, such as conversational cloze tests, are mainly used. In…

This research aimed to develop a valid and reliable test to be used to detect sixth grade students' misconceptions and errors regarding the subject of fractions. A misconception diagnostic test has been developed that includes the concept of fractions, different representations of fractions, ordering and comparing fractions, equivalence of…

Despite widespread studies on language assessment literacy (LAL), there are still many unexplored areas about LAL (Gan & Lam, 2022). One of these areas is identifying various aspects of LAL regarding different language skills and scrutinizing the English as a foreign language (EFL) teachers' involvement with these aspects. Accordingly, this…

The top-down approach to designing a multistage test is relatively understudied in the literature and underused in research and practice. This study introduced a route-based top-down design approach that directly sets design parameters at the test level and utilizes the advanced automated test assembly algorithm seeking global optimality. The…

The continual supply of new items is crucial to maintaining quality for many tests. Automatic item generation (AIG) has the potential to rapidly increase the number of items that are available. However, the efficiency of AIG will be mitigated if the generated items must be submitted to traditional, time-consuming review processes. In two studies,…

During the development of large-scale curricular achievement tests, recruited panels of independent subject-matter experts use systematic judgmental methods--often collectively labeled "alignment" methods--to rate the correspondence between a given test's items and the objective statements in a particular curricular standards document.…

Attitude scales are an important component of educational and psychological research. One consideration when seeking to make valid inferences from attitudinal data is the issue of the degree to which response options can be assumed to have equal intervals. Many response options on attitudinal measures may produce ordinal-level data rather than…

Teachers lack effective curriculum-based instruments to assess their students' scientific competence that would provide information for modifying their inquiry instruction. The main purpose of this study was to develop and validate a Curriculum-Based Scientific Competence (CBSC) test to assess students' scientific competence in a 1-semester Grade…

Derived from the Expectancy-Value Theory (EVT) model, cost has drawn scholarly interest for being predicative of avoidance motivation. The study is an effort to develop and validate an instrument to measure students' perceived costs in physical education. Through literature review and student interviews, a draft of 39 items under seven domains was…

In combat sports, competition preparation is crucial, but research on this topic has been limited due to a lack of measurement tools. This study aimed to develop and validate the Multidimensional Assessment of Preparation for Sport Competition (MAPSC). In the first step, 61 athletes and 39 coaches collaborated to conceptualize and develop…