Prerequisite skill structures have been closely studied in past years leading to many data-intensive methods aimed at refining such structures. While many of these proposed methods have yielded success, defining and refining hierarchies of skill relationships are often difficult tasks. The relationship between skills in a graph could either be…

In online educational systems we can easily collect and analyze extensive data about student learning. Current practice, however, focuses only on some aspects of these data, particularly on correctness of students answers. When a student answers incorrectly, the submitted wrong answer can give us valuable information. We provide an overview of…

This study uses the feature sets employed by two automated scoring engines to determine if a "linguistic profile" could be formulated that would help identify items that are likely to exhibit differential item functioning (DIF) based on linguistic features. Sixteen items were administered to 1200 students where demographic information…

Thanks to the increased accessibility of multimedia technology, video texts have been widely used in teaching English in Chinese foreign language classrooms. This trend provides great impetus for changes in the means of assessing listening in both achievement and proficiency tests, and suggests the potential possibility of supplanting the…

Pragmatic competence is among the explicitly acknowledged sub-competences that make the communicative competence in any language (Bachman & Palmer, 1996; Council of Europe, 2001). Within the notion of pragmatic competence itself, "implicature (implied meanings)" comes to the fore as one of the five main areas there (Levinson, 1983).…

The Monte Carlo approach which has previously been implemented in traditional computerized adaptive testing (CAT) is applied here to cognitive diagnostic CAT to test the ability of this approach to address multiple content constraints. The performance of the Monte Carlo approach is compared with the performance of the modified maximum global…

Interest in developing computerized adaptive testing (CAT) under cognitive diagnosis models (CDMs) has increased recently. CAT algorithms that use a fixed-length termination rule frequently lead to different degrees of measurement precision for different examinees. Fixed precision, in which the examinees receive the same degree of measurement…

Complex Problem Solving (CPS) skills are essential to successfully deal with environments that change dynamically and involve a large number of interconnected and partially unknown causal influences. The increasing importance of such skills in the 21st century requires appropriate assessment and intervention methods, which in turn rely on adequate…

The Information Systems (IS) community has put considerable effort on identifying constructs that may explain the initial/continuance use of computer based learning or assessment systems. This study is a further step toward IS continuance acceptance delivered in Computer Based Assessment (CBA) context. Specifically, it aims at the exploration of…

This article reports on an experiment that examined the comprehension of transitive sentences in Czech children and its relationship to case marking, word order and information structure. A total of 107 Czech children aged 2;9-4;5 were tested for comprehension of noun-verb-noun sentences in which word order and given-new status of individual nouns…

As part of the Race to the Top initiative, the United States Department of Education made nearly 1 billion dollars available in State Educational Technology grants with the goal of ramping up school technology. One result of this effort is that states, districts, and schools across the country are using computerized assessments to measure their…

This fact page briefly discusses the following facts on digital learning in California's K-12: (1) As California implements new tests in its K-12 schools, technology infrastructure is a key concern; (2) Many districts are confident that they had enough bandwidth for online field tests; (3) Digital learning will require significantly greater…

Automated essay scoring programs are becoming more common and more technically advanced. They provoke strong reactions from both their advocates and their detractors. Arguments tend to fall into two categories: technical and principled. This paper argues that since technical difficulties will be overcome with time, the debate ought to be held in…

The effects of study abroad on students' language proficiency have been analyzed using a number of measures such as surveys, questionnaires and oral proficiency exams (Collentine, 2004; Freed, 1995; Segalowitz, & Freed, 2004). Furthermore, researchers have sought to determine the proficiency gains of study abroad (SA) students by comparing…

The role of time on task (TOT) for students' attainment in a low-stakes assessment of cross-curricular skills was examined using the log data collected in the computer-based assessment (CBA). Two structural equation models were compared: Model 1, in which students' test scores were explained by grade point average (GPA) together with mastery and…