There is increasing interest in using factor scores in structural equation models and there have been numerous methodological papers on the topic. Nevertheless, sum scores, which are computed from adding up item responses, continue to be ubiquitous in practice. It is therefore important to compare simulation results involving factor scores to…

This article illustrates how a new framework for conceptualising comparability has the potential to help assessment professionals to understand and to conduct debate on linking theory and practice. The framework was used as a lens through which to study a corpus of research reports, from which a narrative was constructed to characterise the…

In recent years, the Education for All movement has focused more intensely on the quality of education, rather than simply provision. Many recent and current education quality interventions focus on literacy, which is the core skill required for further academic success. Despite this focus on the quality of literacy instruction in developing…

The aim of the present research was to compare the use of multiple-choice questions (MCQs) as an examination method against the oral examination (OE) method. MCQs are widely used and their importance seems likely to grow, due to their inherent suitability for electronic assessment. However, MCQs are influenced by the tendency of examinees to guess…

Classroom assessment techniques (CATs) are teaching strategies that provide formative assessments of student learning. It has been argued that the use of CATs enhances and improves student learning. Although the various types of CATs have been extensively documented and qualitatively studied, there appears to be little quantitative research…

The structure of two-tier testing is such that the first tier consists of a multiple-choice question and the second tier requires justifications for choices of answers made in the first tier. This study aims to evaluate two-tier tasks in "proportion" in terms of students' capacity to write and select justifications and to examine the effect of…

The aim of this study is to argue for alternative assessment methods (i.e. concept map) considering the changes in demography in higher education. In the case of school of dentistry, for example, there is an urgent call for a catalyst for new assessment methods in dental education in view of the drive to comprehensively assess professional…

Group projects are an established but debated pedagogical technique in higher education. The purpose of this study was to assess the appropriateness of combining individual and group marks in assessment. A mixed method design involving correlational and comparative elements was used. The sample included one cohort of students who completed a group…

As the largest international study ever taken in history, the Trend in Mathematics and Science Study (TIMSS) has been held as a benchmark to measure U.S. student performance in the global context. In-depth analyses of the TIMSS project are conducted in this study to examine key issues of the comparative investigation: (1) item flaws in mathematics…

Although there is an ongoing debate about which achievement feedback is most useful, the majority of researchers agree that social comparisons and a focus on competition are inappropriate for students with learning disabilities and otherwise academically-challenged students. They are highly at-risk to be unfavorably influenced by inappropriate…

Statewide exit examinations play an important role in discussions on school effectiveness. Referring to educational governance concepts, this paper presumes a relation between varying organizational structures of statewide examinations across states, and heterogeneous effects on school actors. It is assumed that their ability to affect work in…

When comparing data derived from tests or questionnaires in cross-national studies, researchers commonly assume measurement invariance in their underlying scaling models. However, different cultural contexts, languages, and curricula can have powerful effects on how students respond in different countries. This article illustrates how the…

This pilot study proposes a set of analytical steps for comparing schools that participate in the National Science Foundation's Math and Science Partnership (MSP) Program and their nonparticipating peers in the same state. This pilot is part of a larger effort to evaluate the MSP Program's role in student achievement, with two companion analyses.…

The purpose of this report is to provide an update on the state of the research on testing accommodations, as well as to identify promising areas of research to further clarify and enhance understanding of current and emerging issues. The research described encompasses empirical studies of score comparability and validity studies, as well as…

This study presents the random-effects rating scale model (RE-RSM) which takes into account randomness in the thresholds over persons by treating them as random-effects and adding a random variable for each threshold in the rating scale model (RSM) (Andrich, 1978). The RE-RSM turns out to be a special case of the multidimensional random…