Most computerized adaptive testing (CAT) programs do not allow test takers to review and change their responses because it could seriously deteriorate the efficiency of measurement and make tests vulnerable to manipulative test-taking strategies. Several modified testing methods have been developed that provide restricted review options while…

A goal in many countries is to institute state-wide exams to base student assessment more firmly on norms for all classes. This raises the question as to the extent to which greater standardization of grading practice can be reached by implementing state-wide exit exams. Since there is a lack of longitudinal studies, we analyzed the effect of the…

We rigorously test for discrimination against students with foreign backgrounds in high school grading in Sweden. We analyse a random sample of national tests in the Swedish language graded both non-blindly by the student's own teacher and blindly without any identifying information. The increase in the test score due to non-blind grading is…

Regression, weighting and related approaches to estimating a population mean from a sample with nonrandom missing data often rely on the assumption that conditional on covariates, observed samples can be treated as random. Standard methods using this assumption generally will fail to yield consistent estimators when covariates are measured with…

This research examines issues regarding model estimation and robustness in the use of Bayesian Inference Networks (BINs) for measuring Learning Progressions (LPs). It provides background information on LPs and how they might be used in practice. Two simulation studies are performed, along with real data examples. The first study examines the case…

The probability of test takers changing answers upon review of their initial choices is modeled. The primary purpose of the model is to check erasures on answer sheets recorded by an optical scanner for numbers and patterns that may be indicative of irregular behavior, such as teachers or school administrators changing answer sheets after their…

Increasing numbers of students are applying to university with the International Certificate of Christian Education (ICCE), an alternative to mainstream qualifications based on a biblically-based, individualised curriculum called Accelerated Christian Education (ACE). No formal validity arguments exist for the ICCE, but it claims to prepare…

The media suggest that accountability pressure increases teacher stress and drives teachers away from teaching, resulting in teachers leaving disadvantaged schools that serve larger proportions of poor and minority students. However, no prior work has systematically examined the changes in the national trends of teacher turnover in response to No…

Auditory-verbal therapy (AVT) is an instructional approach for children with hearing loss (HL) that emphasizes auditory learning. Studies relating to the effectiveness of AVT usually relate to speech and language outcomes of young children receiving AVT. Little is known about outcomes of these children later on, such as academic achievements. The…

To classify an item score pattern as not fitting a nonparametric item response theory (NIRT) model, the probability of exceedance (PE) of an observed response vector x can be determined as the sum of the probabilities of all response vectors that are, at most, as likely as x, conditional on the test's total score. Vector x is to be considered…

There is a clear prevalence of equipment and spatial arrangements for traditional teaching from the front of the class in Croatian classrooms. During such instruction, pupils mostly sit, listen and watch. Further, it is evident that primary school classrooms feature several elements pointing to the use of constructivist didactics, and include…

In this commentary, the 3 review papers by Reynolds et al. (this issue), Muijs et al. (this issue), and Hopkins, Stringfield, Harris, Stoll, and Mackay (this issue) on "educational effectiveness", "teaching effectiveness", and "school and system improvement" are discussed. In the text, the 3 papers are occasionally…

Recently there has been an increasing level of interest in subtest scores, or subscores, for their potential diagnostic value. Haberman (2008) suggested a method to determine if a subscore has added value over the total score. Researchers have often been interested in the performance of subgroups--for example, those based on gender or…

This article outlines some key issues for writing effective computer-aided assessment (CAA) questions in subjects with substantial mathematical or statistical content, especially the importance of control of random parameters and the encoding of wrong methods of solution (mal-rules) commonly used by students. The pros and cons of using CAA and…

Dependent effect size estimates are a common problem in meta-analysis. Recently, a robust variance estimation method was introduced that can be used whenever effect sizes in a meta-analysis are not independent. This problem arises, for example, when effect sizes are nested or when multiple measures are collected on the same individuals. In this…