Reliability is the consistency of a set of scores that are designed to measure the same thing. Reliability is a statistical property of scores that must be demonstrated rather than assumed.

Quality control (QC) in testing is paramount. QC procedures for tests can be divided into two types. The first type, one that has been well researched, is QC for tests administered to large population groups on few administration dates using a small set of test forms (e.g., large-scale assessment). The second type is QC for tests, usually…

Evaluating Learners' Response in an e-Learning environment has been the topic of current research in areas of Human Computer Interaction, e-Learning, Education Technology and even Natural Language Processing. The current paper presents a twofold strategy to evaluate single word response of a learner in an e-Learning environment. The response of…

In this essay, we describe the construction and use of the Cut-Score Operating Function in aiding standard setting decisions. The Cut-Score Operating Function shows the relation between the cut-score chosen and the consequent error rate. It allows error rates to be defined by multiple loss functions and will show the behavior of each loss…

The term "fidelity" is often used in educational contexts to describe the degree to which a practitioner follows the prescribed directions when delivering an instructional program (Sanetti & Kratochwill, 2009; Dane & Schneider, 1998). Within a Response to Intervention (RTI) framework, the term fidelity also extends to assessment…

The professional development organizations educate the local decision-makers by reducing the risks of automated scoring technologies to language and writing practices. These automated assessments lead to changes, which benefits private industry and conflicts with research on writing and language.

Five categories of answer-processing for computerized drill programs in foreign languages are described: nonevaluation, right-wrong evaluation, pattern markup, error anticipation, and parsing. Each strategy is explained in terms of its operation, advantages and disadvantages, ease of use for authoring courseware, and capability to support…

Clues in the answers given to the Spanish Advanced Placement Examination questions can identify the test-taker as having learned the language in the classroom or as a native speaker. The Educational Testing Service has found mechanisms to ensure that the tests are equally suited to the two groups. (MSE)