This article presents the process of constructing and validating a test of metalinguistic awareness (MLA) for young school children (age 8-10). The test was developed between 2021 and 2023 as part of the MetaLearn research project, financed by The Research Council of Norway. The research team defines MLA as using metalinguistic knowledge at a…

Artificial intelligence (AI) technologies have the potential to reduce the workload for the second language (L2) teachers and test developers. We propose two AI distractor-generating methods for creating Chinese vocabulary items: semantic similarity and visual similarity. Semantic similarity refers to antonyms and synonyms, while visual similarity…

Technology-enhanced items (TEIs) are innovative, computer-delivered test items that allow test takers to better interact with the test environment compared to traditional multiple-choice items (MCIs). The interactive nature of TEIs offer improved construct coverage compared with MCIs but little research exists regarding students' performance on…

Relatively little is known about differences in the quality of engineering education within and across countries because of the lack of valid instruments that allow for the assessment and comparison of engineering students' skill gains. The purpose of our study is to develop and validate instruments that can be used to compare student skill gains…

This study investigated the cognitive validity of two child English language tests. Some teachers maintain that these types of tests may be cognitively invalid because native-English-speaking children would not do well on them (Winke, 2011). So the researchers had native speakers and learners of English aged 7 to 9 take sample versions of two…

Introduction: Learning difficulties (LD) is a recent construct. It has been agreed that the individual who suffers from learning difficulties has a disorder in one or more of the basis psychological processes, including attention, cognition, formation of concepts, memory, problem solving, understanding or reading, speaking or writing, or…

The Tuning-Medicine Project produced a set of "level one" and "level two" learning outcomes/competences to be met by European medical graduates. In the learner-centered era self-assessment becomes more and more important. Our aim was to develop a self-completion questionnaire ("iCAN!") evaluating graduates' learning…

Three test construction strategies are described and illustrated in the development of the Verb Interest Test (VIT), an inventory that assesses vocational interests using verbs. Verbs might be a promising alternative to the descriptions of occupational activities used in most vocational interest inventories because they are context-independent,…

This article illustrates how test specifications based solely on academic content standards, without attention to other cognitive skills and item response demands, can fall short of their targeted constructs. First, the authors inductively describe the science achievement construct represented by a statewide sixth-grade science proficiency test.…

The purpose of this manuscript was to develop and test the psychometric properties of the Environmental Restriction Questionnaire (ERQ) a parent-reported questionnaire for measuring perceived environmental restrictions for young children participation. Reliability and homogeneity were tested by Cronbach's alpha and inter-item correlations.…

The present study was aimed at developing an attitude scale and then use it to reveal the attitude of mathematical gifted students' attitude towards mathematics. In the first phase of the study, an attitude-scale (AS) towards mathematics were designed using the psychometric approach. The AS was composed of seventeen items aimed to measure four…

Enculturation is the degree to which a person adheres to the values and behaviors of an indigenous or ethnic culture. This study was conducted to develop the Enculturation Scale for Filipino Americans (ESFA). Items were generated from a literature review, interviews with 5 Filipino American academic experts, and a survey of 24 cultural informants.…

Covariance modeling techniques were used to test the assumption of group invariance of a computer anxiety scale by comparing results from potentially different populations: 258 college students and 320 law enforcement officers. Results support the idea that the validity of the computer anxiety construct can be generalized to different groups.…

A study examined the relationship of native language and level of English proficiency to the structure of the Test of English as a Foreign Language (TOEFL). Using all of the information provided by various responses to the test's items (the four alternatives, omitted, and not reached), the items' interrelations were analyzed by three-way…

A study investigated whether or not a discrete-item test of English affixes could be used to measure second language reading comprehension. Subjects were 1,254 mostly first-year university students in four academic departments studying to pass the first half of a foreign language requirement, an English reading comprehension test. Results from two…