This study describes the development and validation process of a computational thinking (CT) test for adults. The team designed a set of items and explored a subset of those through two qualitative pilots. Then, in order to provide validity evidence based on the test content, a team of 11 subject-matter experts coded the initial pool of items…

With the increasing importance of Computational Thinking (CT) at all levels of education, it is essential to have valid and reliable assessments. Currently, there is a lack of such assessments in upper primary school. That is why we present the development and validation of the competent CT test (cCTt), an unplugged CT test targeting 7-9 year-old…

Computational thinking (CT) is an emerging and multifaceted competence important to the computing era. However, despite the growing consensus that CT is a competence domain, its theoretical and empirical account remain scarce in the current literature. To address this issue, rigorous psychometric evaluation procedures were adopted to investigate…

The main purpose of this study is to develop and validate a multidimensional instrument for measuring mobile learning systems success (MLSS) based on the previous research. This study defines the construct of MLSS, develops a generic MLSS instrument with desirable psychometric properties, and explores the instrument's theoretical and practical…

The past few years have witnessed great developments in Internet infrastructure, which have led to increased Internet usage among people of various age groups. However, at the same time, there have been some negative implications associated with increased Internet usage for some individuals. "Internet addiction" (IA) is one such negative…

This study investigated whether participating in a 3D immersive virtual reality world simulating the experience of test-anxiety would affect preservice teachers' awareness to the phenomenon. Ninety subjects participated in this study, and were divided into three groups. The experimental group experienced a 3D immersive simulation which made…

Recently, several scholars have suggested that academic self-regulation may be particularly important for students participating in online learning. The purpose of the present study was to develop a quantitative self-report measure of perceived task value and self-efficacy for learning within the context of self-paced, online training, and to…

This empirical study of undergraduates compared the psychometric properties, i.e., reliability and validity, of four computer attitude measures and their subscales. Results are analyzed that indicate all measures tested were essentially equal in terms of reliability and validity, and attempts to empirically derive improved scales were…

Discusses the design of online scoring software for computer-based education supporting high psychometric and fairness standards. Describes a system from the point of view of graders and supervisors; the design of the underlying database; data integrity and confidentiality; and the advantages of database design and online grading. (PEN)

Test equivalence can be evaluated in terms of four aspects: psychometric, behavioral, experiential, and individual differences (i.e., relativity of equivalence) (Honaker, 1988). This study examined the psychometric properties of the Attitude Towards Computerized Assessment Scale (ATCAS) designed to assess one of these criteria, namely,…

Powers, Burstein, Chodorow, Fowles, and Kukich (2002) suggested that automated essay scoring (AES) may benefit from the use of "general" scoring models designed to score essays irrespective of the prompt for which an essay was written. They reasoned that such models may enhance score credibility by signifying that an AES system measures the same…

Formulates sequential rules for adapting the appropriate amount of instruction to learning needs in the context of computer-based instruction. Topics include Bayesian decision theory, threshold and linear-utility structure, psychometric model, optimal sequential number of test questions, and an empirical example of sequential instructional…

This study investigated the statistical and practical significance of context effects for items randomized within testlets for administration during a series of computerized non-adaptive tests. One hundred and twenty-five items from four primary school reading tests were studied. Logistic regression analyses identified from one to four items for…

A major determinant of the success of educational intranet sites is their usability. In addition to measures of task performance and navigation behavior, psychometric instruments are used to evaluate usability and the quality of human-computer interaction more generally. However, there is a lack of validated instruments for the evaluation of…

Traditional student evaluations of teaching do not adequately assess the essential constructivist-based practices that have been recommended for effective online instruction. There is a need for student evaluation of teaching instruments that are specifically designed to provide online instructors with valid feedback about the effectiveness of…