Causal sequences can be segmented into cause and effect. However, some argue causal relations in discourse are by default in "effect-cause" order. Others claim "cause-effect" order is easier to process and the default way of expressing causality, due to iconicity. We conducted experiments testing participants' production…

The divisibility of the reading has led many researchers to examine whether reading construct is a unitary skill that cannot be divided into separate sub-skills, or it is composed of underlying components. In these studies, however, participants have generally been located in a product-oriented testing environment where their actual reading…

Historically, the implementation of research-based assessments (RBAs) has been a driver of educational change within physics and helped motivate adoption of interactive engagement pedagogies. Until recently, RBAs were given to students exclusively on paper and in class; however, this approach has important drawbacks including decentralized data…

Using game-based learning strategies, such as quiz-style PowerPoint games as an e-learning and teaching pedagogy can make a positive impact on how students learn, how they process and retain information, and how they interact with digital media. However, little is known about their impact on students' information literacy development. This…

This paper presents an innovative method to tackle the automatic evaluation of programming assignments with an approach based on well-founded assessment theories (Classical Test Theory (CTT) and Item Response Theory (IRT)) instead of heuristic assessment as in other systems. CTT and/or IRT are used to grade the results of different items of…

In this research report, we describe the design and empirical findings for a large-scale study of essay writing ability with approximately 2,500 high school students in Germany and Switzerland on the basis of 2 tasks with 2 associated prompts, each from a standardized writing assessment whose scoring involved both human and automated components.…

Many assessments of writing proficiency that aid in making high-stakes decisions consist of several essay tasks evaluated by a combination of human holistic scores and computer-generated scores for essay features such as the rate of grammatical errors per word. Under typical conditions, a summary writing score is provided by a linear combination…

The paper reports the results of a phenomenographic study on academics' conceptions of e-assessment. A cohort of 21 academics from 17 disciplines participated in semi-structured interviews exploring their experiences of using web-based technologies for formative and summative assessment purposes. Through iterative analysis of the interview…

Critical thinking, problem solving and communication are fundamental elements of undergraduate education, but methods for assessing these skills across an institution are susceptible to logistical, motivational and financial issues. Queen's University conducted two research studies investigating the use of standardised tests to assess cognitive…

The interest in, and use of, computers and software for assessment is reported to be increasingly popular via electronic examinations (e-exams). We deepen our understanding of the design, reception, and effectiveness of e-exams for history and philosophy of science modules, undertaken by first-year advanced science and medical science students at…

Assessing job applicants' general mental ability online poses psychometric challenges due to the necessity of having brief but accurate tests. Recent research (Myszkowski & Storme, 2018) suggests that recovering distractor information through Nested Logit Models (NLM; Suh & Bolt, 2010) increases the reliability of ability estimates in…

Polytomous items are typically described by multiple category-related parameters; situations, however, arise in which a single index is needed to describe an item's location along a latent trait continuum. Situations in which a single index would be needed include item selection in computerized adaptive testing or test assembly. Therefore single…

This research proposes the development of a web-based assessment system to identify students' misconception. The system, named WAS (web-based assessment system), can identify students' misconception profile on linear kinematics automatically after the student has finished the test. The test instrument was developed and validated. Items were…

This article provides an overview and evaluation of the uses--actual and potential--of automatic speech recognition (ASR) and spoken dialogue systems (SDS), related technologies that can be applied to second language speaking assessment, given particular definitions of the construct. Both technologies have only gradually moved in the direction of…

The Discrete Option Multiple Choice (DOMC) item format was introduced by Foster and Miller (2009) with the intent of improving the security of test content. However, by changing the amount and order of the content presented, the test taking experience varies by test taker, thereby introducing potential fairness issues. In this paper we…