This research aims to compare the ability and item parameter estimations of Item Response Theory according to Maximum likelihood and Bayesian approaches in different Monte Carlo simulation conditions. For this purpose, depending on the changes in the priori distribution type, sample size, test length, and logistics model, the ability and item…

The examination of the testing mode effect has received increased attention as higher education has shifted to remote testing during the COVID-19 pandemic. We believe the testing mode effect consists of four components: the ability to physically write on the test, the method of answer recording, the proctoring/testing environment, and the effect…

Education systems increasingly emphasize the importance of scientific reasoning skills such as "generating hypotheses" and "evaluating evidence." Despite this importance, we do not know which tests of scientific reasoning exist, which skills they emphasize, how they conceptualize scientific reasoning, and how well they are…

The current paper on writing assessment surveys the literature on the reliability and validity of essay tests. The paper aims to examine the two concepts in relationship with essay testing as well as to provide a snapshot of the current understandings of the reliability and validity of essay tests as drawn in recent research studies. Bearing in…

Recently, there has been an increasing level of interest in subscores for their potential diagnostic value. Haberman (2008) suggested a method based on classical test theory to determine whether subscores have added value over total scores. This paper provides a literature review and reports when subscores were found to have added value for…

This chapter introduces theory that undergirds the role of testing adaptations in assessment, provides examples of item modifications and testing accommodations, reviews research relevant to each, and introduces a new paradigm that incorporates opportunity to learn (OTL), academic enablers, testing adaptations, and inferences that can be made from…

Study compares Wechsler (WISC-R) profiles of special-education students to seven core types distinguished primarily by levels of global ability. More than 96% of these students were found to be similar to one of the core types considered to be common variants of normal intellectual ability. Based on data, it is recommended that "no way"…

Provides a history of validation in language testing, discusses current approaches to validation in language testing (hypothesis about testing outcomes, relevant evidence for testing the hypothesis, developing a validity argument), and gives an overview of current challenges in language-test validation (defining the language construct to be…

Presents an overview of linking methods applied to performance assessment and discusses major issues and recent developments in linking performance assessments. Compares three common linking designs and two major linking methodologies (classical and item response theory (IRT)). Describes two classical equating methods and several IRT equating…

Argues that the apparent lack of empirical support for the practice of profile analysis has stemmed in part from the use of statistical techniques that have neglected to explore the perspective of the clinician. Explores Configural Frequency Analysis, a statistical technique focusing on the relationships among groups of participants as the unit of…

Argues that IQ tests work only for some people some of the time. Offers a theory that emphasizes the roles in intelligence of information-processing, the environmental context, and coping with novelty and automatization of task performance, as a possibility for improving levels of prediction. (CMG)

This article focuses on Louis Guttman's contributions to the classical theory of educational and psychological tests, one of the lesser known of his many contributions to quantitative methods in the social sciences. Guttman's work in this field provided a rigorous mathematical basis for ideas that, for many decades after Spearman's initial work,…

This review presents an overview of selected articles on the leniency hypothesis: the idea that students give higher evaluations to instructors who grade more leniently. Such articles comprise a small subset of the voluminous research on student evaluations of teaching (SETs). In this diverse literature, research methods and aims have frequently…

The findings and conclusions from research on predictive validity among markedly different groups are discussed. Empirical findings using the regression line neither support nor contradict the existence of bias or the hypothesis of differential validity. Conclusions drawn from the research are questionable. Elimination of bias in a test, contrary…

The need to use images and imagery in language in schools, and to recognize and measure such aptitudes are discussed. Tests of imagination are presented, and the San Francisco Art Institute Study of predictors of ability in art illustrates methods and implications for measurement of creativity in educational programs. (CM)