Purposes: This study uses think-alouds and cognitive interviews to provide validity evidence for an online formative assessment--i-Ready Standards Mastery (iSM) mini-assessments--which involves a heavy use of innovative items. iSM mini-assessments are intended to help teachers determine student understanding of each of the on-grade-level Common…

Serious games foster the acquisition of complex problem-solving skills. Assessment of such skills should be in line with instruction, and within a serious game environment its content validity should equal face-to-face assessment. Research on assessment in serious gaming has remained rather scarce. This article shows how assessment can be…

Typical assessment systems often measure isolated ideas rather than the coherent understanding valued in current science classrooms. Such assessments may motivate students to memorize, rather than to use new ideas to solve complex problems. To meet the requirements of the Next Generation Science Standards, instruction needs to emphasize sustained…

This study aimed to determine EFL (English as a Foreign Language) teachers' perceptions and experience regarding their use of "GradeCam Go!" to grade multiple choice tests. The results of the study indicated that the participants overwhelmingly valued "GradeCam Go!" due to its features such as grading printed forms for…

The purpose of this study was to understand the process of transitioning from the 2002 version of the GED test to the new 2014 computer-based version. Specifically, this research sought to identify: (1) stakeholder attitudes regarding the new computer-based test; (2) the relationship between students' computer access/comfort and their perceptions…

Test takers' beliefs or experiences have been overlooked in most validation studies in language education. Meanwhile, a mutual exclusion has been observed in the literature, with little or no dialogue between validation studies and studies concerning the uses and consequences of testing. To help fill these research gaps, a group of Senior III…

With the rapid advances in computer technology during recent years, researchers have demonstrated the pivotal influences of computer-assisted diagnostic systems on student learning performance improvement. This research aims to develop a Diagnostic and Remedial Learning System (DRLS) for an algebra course in a Thai lower secondary school context…

In Hong Kong, onscreen marking (OSM) is superseding paper-based marking (PBM) across the entire national examinations system. This paper describes a qualitative study of the attitudes of Liberal Studies markers towards OSM. This becomes a compulsory subject in Hong Kong's new senior secondary school curriculum to be first examined in 2012, with a…

This paper presents a novel task-oriented, user-centered, multi-method evaluation (TUME) technique and shows how it is useful in providing a more complete, practical and solution-oriented assessment of the accessibility and usability of Learning Management Systems (LMS) for blind and visually impaired (BVI) students. Novel components of TUME…

The potential use of computer-based assessments has raised concerns from educators, policymakers, and parents about information technology infrastructure in school districts and the preparation of staff and students to use new technologies for assessment purposes, and the potential impact of testing activities on core school functions,…

Pedagogic Conversational Agents are computer applications that can interact with students in natural language. They have been used with satisfactory results on the instruction of several domains. The authors believe that they could also be useful for the instruction of Secondary Physics and Chemistry Education. Therefore, in this paper, the…

The purpose of these case studies was to examine the ways technology and professional development supported the use of the SimScientists assessment systems. Qualitative research methodology was used to provide narrative descriptions of six classes implementing simulation-based assessments for either the topic of Ecosystems or Atoms and Molecules.…

This paper reports the results of a descriptive study on the use of a technology-enhanced formative assessment system called Accelerated Math (AM) for ELLs and their native-English-speaking (NES) peers. It was comprised of analyses of an extant database of 18,549 students, including 2,057 ELLs, from grades 1 through 8 across 30 U.S. states. These…

Critical thinking is a skill that school systems are trying to develop in their student populations. Numerous studies have been conducted on developing critical thinking skills such as self-regulation, interpretation, and analysis. However, available data on the use of learning management systems (LMS) as a means to develop critical-thinking…

Motivation in distance education (DE) has been studied mostly at the postsecondary level with few studies having been conducted at the high-school level. This paper breaks with this tradition by reporting on the perspectives on motivation of 42 Canadian high-school DE teachers. Data collection involved one-hour long, semi-structured telephone…