Despite the majority of MCQ writing guides discouraging the use of negatively-worded multiple choice questions (NWQs), they continue to be regularly used both in locally produced examinations and commercially available questions. There are several reasons why the use of NWQs may prove resistant to sound pedagogical advice. Nevertheless, systematic…

Action research was undertaken to begin to explore the possibility of improving second-language Thai college student performance on completion questions by using bolded and underscored words in test item stems, called "assist devices." This intervention was designed to focus student attention on key terms. Twenty-one students, in an…

Situational judgment tests (SJTs) are widely agreed to be a measurement technique. It is also widely agreed that SJTs are a questionable methodological choice for measurement of psychological constructs, such as behavioral competencies, due to a lack of evidence supporting appropriate factor structures and high internal consistencies.…

The purpose of this study was to develop a rating scale that can be used to evaluate behavior patterns of the organization people pattern of preservice teachers (PSTs). By reviewing the related literature on people patterns, a preliminary scale of 38 items with a five-points Likert type was prepared. The number of items was reduced to 29 after…

Recent efforts to reform K-12 science curricula, embedded within the "NRC Framework for K-12 Science Education" and the "Next Generation Science Standards," have focused on unifying core disciplinary content with crosscutting concepts that span across science disciplines and scientific practices. With these reforms comes the…

This article shows that the Korean Extrinsic Plural Marker (EPM) may be acquired by children on the basis of very little evidence. The EPM marks distributivity, unlike the Instrinsic Plural Marker, which marks plurality. Thirty monolingual learners of Korean aged 5;03 to 6;09 (mean age 6;01) were tested using a series of Truth Value Judgment Tasks…

Valid inferences on teaching drawn from students' test scores require that tests are sensitive to the instruction students received in class. Accordingly, measures of the test items' instructional sensitivity provide empirical support for validity claims about inferences on instruction. In the present study, we first introduce the concepts of…

This article illustrates five different methods for estimating Angoff cut scores using item response theory (IRT) models. These include maximum likelihood (ML), expected a priori (EAP), modal a priori (MAP), and weighted maximum likelihood (WML) estimators, as well as the most commonly used approach based on translating ratings through the test…

This study examined changes in China's college student fitness test batteries since its inception in 1954. Using the constant content comparison method, the testing components, testing items and related cut-off values, testing methods, testing results utility, and testing material distribution were examined to identify the salient trends. The…

The present study investigates the best factor for controlling the item difficulty of multiple-choice English vocabulary questions generated by an automatic question generation system. Three factors are considered for controlling item difficulty: (1) reading passage difficulty, (2) semantic similarity between the correct answer and distractors,…

Exams assessment is one of the most tedious work for university teachers all over the world. Multiple choice theses make exams assessment a little bit easier, but the teacher cannot prepare more than 3-4 variants; in this case, the possibility of students for cheating from one another becomes a risk for "objective assessment outcome." On…

This study uses the nominal response model to investigate the effects of extreme response styles. The Zung Self-Rating Anxiety Scale (SAS) is a commonly used scale for the identification of anxiety disorders. In some cases, the response options are not extreme, ranging from "A little of the time" to "Most of the time;" in other…

Large-scale assessments are supported by a large item pool. An important task in test development is to assign items into scales that measure different characteristics of individuals, and a popular approach is cluster analysis of items. Classical methods in cluster analysis, such as the hierarchical clustering, K-means method, and latent-class…

This article examines whether the way that PISA models item outcomes in mathematics affects the validity of its country rankings. As an alternative to PISA methodology a two-parameter model is applied to PISA mathematics item data from Canada and Finland for the year 2012. In the estimation procedure item difficulty and dispersion parameters are…

After explicit instruction on how to give possible bidirectional (two-way) causality explanations for a correlation, 240 students from eight sections of social psychology and research methods courses wrote "reverse causality" explanations on various test questions, creating a total of 882 answers. Averaging across multiple graded…