The Monte Carlo approach which has previously been implemented in traditional computerized adaptive testing (CAT) is applied here to cognitive diagnostic CAT to test the ability of this approach to address multiple content constraints. The performance of the Monte Carlo approach is compared with the performance of the modified maximum global…

Testing Theory-based Quantitative Predictions (TTQP) represents an alternative to traditional Null Hypothesis Significance Testing (NHST) procedures and is more appropriate for theory testing. The theory generates explicit effect size predictions and these effect size estimates, with related confidence intervals, are used to test the predictions.…

The traditional JAVA course examination is just a list of questions from which we cannot know students' skills of programming. According to the eight abilities in curriculum objectives, we designed an assessment standard of JAVA programming course that is based on employment orientation and apply it to practical teaching to check the teaching…

Since the passage of No Child Left Behind, large-scale assessments have come to play a central role in federal and state education accountability systems. Teachers and parents have expressed a number of concerns about their state testing programs, such as too much time devoted to testing and the high-stakes use of testing for teacher evaluation.…

Most, if not all, computerized adaptive testing (CAT) programs use simulation techniques to develop and evaluate CAT program administration and operations, but such simulation tools are rarely available to the public. Up to now, several software tools have been available to conduct CAT simulations for research purposes; however, these existing…

Against the background of concerns for how paper-and-pencil testing fits into contemporary language teaching, this brief research report presents the findings of a first study on the difference in scores between in-class testing and online testing in a communicative and proficiency-oriented program. A total of 244 students of third-semester…

This study investigated the impact of anonymizing text on predicted scores made by two kinds of automated scoring engines: one that incorporates elements of natural language processing (NLP) and one that does not. Eight data sets (N = 22,029) were used to form both training and test sets in which the scoring engines had access to both text and…

Heterogeneity in meta-analysis is most commonly estimated using a moment-based approach described by DerSimonian and Laird. However, this method has been shown to produce biased estimates. Alternative methods to estimate heterogeneity include the restricted maximum likelihood approach and those proposed by Paule and Mandel, Sidik and Jonkman, and…

With recent developments in technology, online tests and digital tools offer school psychologists and school counsellors alternate modes of assessment. These new technologies have the potential to increase accessibility to tests (through greater portability), allow school psychologists and school counsellors to service more students (through…

Informed by Goffman's influential essay on "The neglected situation" this paper examines the contextual and interactive dimensions of performance in large-scale educational assessments. The paper applies Goffman's participation framework and associated theory in linguistic anthropology to examine how testing situations are framed and…

This research investigated the difficulty of examination questions for students with weaker reading skills. Item level performance data were obtained for all candidates who took a maths examination (for 16 year olds). A sub-group of students who had access to a reader was identified (students with proven reading difficulties are permitted to have…

Traditional parallel analysis (T-PA) estimates the number of factors by sequentially comparing sample eigenvalues with eigenvalues for randomly generated data. Revised parallel analysis (R-PA) sequentially compares the "k"th eigenvalue for sample data to the "k"th eigenvalue for generated data sets, conditioned on"k"-…

We tested four predictions based on the assumption that optional infinitives can be attributed to properties of the input whereby children inappropriately extract non-finite subject-verb sequences (e.g. "the girl run") from larger input utterances (e.g. "Does the girl run?" "Let's watch the girl run"). Thirty children…

Of the more than one million new students who enter community colleges each fall, nearly 70 percent are assigned to remedial coursework. The cost of providing this coursework is high, yet evidence about the effectiveness of remediation is not compelling. In addition, many students are misclassified in the remedial assessment process. In order for…

An adaptive learning system is proposed that incorporates a Bayesian network to efficiently gauge learners' understanding at the course-unit level. Also, learners receive content that is adapted to their measured level of understanding. The system works on an iPad via the Edmodo platform. A field experiment using the system in an elementary school…