Given the importance of fostering students' interest as a goal of physics education in meeting international science standards, empirical support for the theoretical description of the interest construct is essential. Empirical studies require the use of psychometrically sound measurement instruments. This study developed an instrument to measure…

Computational thinking (CT) has been recognized as an essential part of every child's education (Wing, 2006) and Bebras contest items have been frequently used to measure CT. Think alouds has emerged as a prominent method for identifying thought processes and correcting problems with assessments. As little research has examined validity evidence…

We describe the use of think alouds to examine substantive processes involved in performance on a formative assessment of computational thinking (CT) designed to support self-regulated learning (SRL). Our task design model included three phases of work on a computational thinking problem: forethought, performance, and reflection. The cognitive…

Artificial intelligence (AI) technologies have the potential to reduce the workload for the second language (L2) teachers and test developers. We propose two AI distractor-generating methods for creating Chinese vocabulary items: semantic similarity and visual similarity. Semantic similarity refers to antonyms and synonyms, while visual similarity…

There has been a steady interest in investigating the validity of language tests in the last decades. Despite numerous studies on construct validity in language testing, there are not many studies examining the construct validity of a reading test. This paper reports on a study that explored the construct validity of the English reading test in…

Purposes: This study uses think-alouds and cognitive interviews to provide validity evidence for an online formative assessment--i-Ready Standards Mastery (iSM) mini-assessments--which involves a heavy use of innovative items. iSM mini-assessments are intended to help teachers determine student understanding of each of the on-grade-level Common…

Language assessment literacy has become a critical competence for a language teacher to have. Accordingly, there are many studies in the literature which have researched different aspects of language assessment literacy (i.e., language assessment training, professional development and language assessment literacy levels of language teachers).…

Two studies were conducted to examine and compare the construct validity of scores on the Junior Metacognition Awareness Inventory (JMAI) and problem-solving interview protocols. Participants consisted of 183 middle and high school students attending a university summer program for academically talented youth. Study 1 results indicated that JMAI…

In language learning contexts, writing tasks that involve reading of source texts are often used to elicit more authentic integrative language use. Thus, interests in researching these read-to-write tasks in general and as assessment tasks keep growing. This study examined and modeled the process of summary writing as a read-to-write integrated…

The emphasis on scientific inquiry has increased the importance in developing the fundamental abilities to conduct scientific investigations and urged a need for valid assessments of students' inquiry abilities. We took advantage of the advanced technology to develop a simulation-based assessment of inquiry abilities (SAIA) that allowed…

The main purpose of this study is to develop and validate a valid measure of the early childhood (EC) English teacher knowledge. Through extensive literature review on second/foreign language (L2/FL) teacher knowledge, early childhood teacher knowledge and early childhood language teacher knowledge, and semi-structured interviews from current…

The objective of this study was to investigate the substantive aspect of construct validity of the Satisfaction with Life Scale adapted for Children (SWLS-C; Gadermann et al. in Soc Indic Res 96:229-247, "2010"). Specifically, the study examined the cognitive processes of children when responding to the items of the SWLS-C to find out how they…

Metacognition is widely studied for its influence on the effectiveness of learning. With Exploratory Computer-Based Learning Environments (ECBLE), metacognition is found to be especially important because these environments require adaptive metacognitive control by the learners due to their open-ended structure that allows for multiple learning…

In this article we present results of a Differential Item Functioning (DIF) study using Shealy and Stout's (1993) multidimensionality-based DIF analysis framework. In this framework, differences in test score distributions across different groups of examinees may be a result of multidimensionality if secondary dimensions (not the primary dimension…

Context: Evolution from novice to expert is associated with the development of expert-type knowledge structure. The objectives of this study were to examine reliability and validity of concept sorting (ConSort[C]) as a measure of static knowledge structure and to determine the relationship between concepts in static knowledge structure and…