There are thousands of participants in different programming MOOCs (Massive Open Online Courses) which means thousands of solutions have to be assessed. As it is very time-consuming to assess that amount of solutions manually, using automated assessment is essential. Since task requirements must be strict for the solutions to be automatically…

This paper analyzes the nature and perceived effects of mid-stakes testing (known as the EQAO) in Ontario, Canada. Ontario's mid-stakes tests were meant to ensure accountability and transparency, and assure system-wide improvement, while avoiding the negative effects and perverse incentives of their high-stakes counterparts. The paper provides new…

One of the methods of controlling test security in adaptive testing is imposing random item-ineligibility constraints on the selection of the items with probabilities automatically updated to maintain a predetermined upper bound on the exposure rates. Three major improvements of the method are presented. First, a few modifications to improve the…

Creativity is linked to broad scope of attention, a state or trait that allocates attentional resources over a wide range of perceptual stimuli. According to the attentional priming hypothesis, a mechanism underlying the creativity--attention link is that broad perceptual attention scope primes broad conceptual attention scope--the activation of a…

Previously reward-associated stimuli persistently capture attention. We attempted to extinguish this attentional bias through a reversal learning procedure where the high-value color changed unexpectedly. Attentional priority shifted during training in favor of the currently high-value color, although a residual bias toward the original high-value…

Recent studies suggest that testing on prior material enhances subsequent learning of new material. Although such forward testing effect has received extensive empirical support, it is not yet clear how testing facilitates subsequent learning. One possible explanation suggests that interim testing informs learners about the format of an upcoming…

Purpose: The purpose of the self-study is two-fold: first, to aid in redressing the lack of attention given to the professional development i.e., the building of practical or work-related knowledge of examination invigilators and second, to forward the idea that engaging the examination invigilation process reflectively is an effective form of…

This article presents the discussion and the conclusion of an "EERJ" Special Issue on accountability policy forms in four European educational systems aimed at identifying how global schemes and instruments of accountability are integrated into national governance patterns. The comparative discussion indicates that accountability…

This book provides a critical analysis of the neoliberal reform agenda of the economic governance of schools. Focusing on the role of the United States in this process, it explores the transformation of schools in this agenda from educational establishments to enterprises in a competitive education market. The study uses Bourdieu to apply a…

Teacher license reciprocity allows educators who hold a teaching license in one state to earn a license in another state, subject to meeting state-specific requirements. Reciprocity agreements allow states to work through variations in licensing systems to coordinate license transfers and fill vacant teaching positions with qualified candidates.…

Participants in achievement tests or psychometric scales can be naturally divided into various sub-groups such as gender, race, social economic status, school district, etc. In order to make meaningful comparison between groups, each item in the test/scale should measure the same underlying construct for participants came from different groups.…

We used data simulations to test whether composites consisting of cohesive subtest scores are more accurate than composites consisting of divergent subtest scores. We demonstrate that when multivariate normality holds, divergent and cohesive scores are equally accurate. Furthermore, excluding divergent scores results in biased estimates of…

Diagnostic classification models (DCMs) can provide multidimensional diagnostic feedback about students' mastery levels of knowledge components or attributes. One advantage of using DCMs is the ability to accurately and reliably classify students into mastery levels with a relatively small number of items per attribute. Combining DCMs with…

With the widespread use of technology in the assessment field, many testing programs use both computer-based tests (CBTs) and paper-and-pencil tests (PPTs). Both the Standards for Educational and Psychological Testing (AERA, APA, & NCME, 2014) and the International Guidelines on Computer-Based and Internet Delivered Testing (International Test…

The instructions in this manual explain the responsibilities of school administrators for the New York State Testing Program (NYSTP) Grades 3-8 English Language Arts and Mathematics Tests. School administrators must be thoroughly familiar with the contents of the manual and the policies and procedures must be followed as written so that testing…