The literature on Automated Essay Scoring (AES) systems has provided useful validation frameworks for any assessment that includes AES scoring. Furthermore, evidence for the scoring fidelity of AES systems is accumulating. Yet questions remain when appraising the scoring performance of AES systems. These questions include: (a) which essays are…

The purpose of this study is to examine the effects of assessment method (essays vs. examinations) and instruction method (seminars vs. lectures) on student perceptions of the fairness of the assessment process. Department-specific combinations of these factors give a unique profile to the assessment process and to the way students interact with…

These guidelines describe considerations relevant to the assessment of test takers in or across countries or regions that are linguistically or culturally diverse. The guidelines were developed by a committee of experts to help inform test developers, psychometricians, test users, and test administrators about fairness issues in support of the…

The purpose of this manuscript is, first and foremost, to present new research in the Information Systems realm that will support future research into perceptions of Visual Appeal in an online environment. In furtherance of these goals, the research draws on Composition Theory to articulate a two-essay research agenda. Composition Theory states…

This study has attempted to investigate the administered written tests in the language department of Islamic Azad University of Hamedan, Iran from validity, practicality and reliability points of view. To this end two steps were taken. First, examining 112 tests, we knew that the face validity of 50 tests had been threatened, 9 tests lacked…

Testing the hypotheses that reflective timed-essay prompts should elicit memories of meaningful experiences in students' undergraduate education, and that computer-mediated classroom experiences should be salient among those memories, a combination of quantitative and qualitative research methods paints a richer, more complex picture than either…

Language arts teachers participated in an inservice program, The Writer's Clinic, and evaluated their students' improvement in writing ability using holistic essay scoring techniques. Seventh and eighth grade students were administered an essay composition pretest in December; the same essay topic was given as the post test in May. Students were…

Test format can influence test performance as well as the nature and extent of general classroom achievement. (Authors)

A study within one Australian college of education investigated the appropriateness of literature-based essays to test learning and attitudes of students and faculty toward the assessment method. It is concluded that a number of faculty had shortcomings in theoretical knowledge of assessment, and that use of these essays frequently failed to meet…

This article reports the results of an investigation of the convergent criterion-related validity of two computer-based tools for scoring concept maps and essays as part of the ongoing formative evaluation of these tools. In pairs, participants researched a science topic online and created a concept map of the topic. Later, participants…

The test scores of college freshmen given both a multiple choice test and an essay test of writing skills were compared to assess the validity of a multiple choice test compared with an essay test. (HOD)

The goal of teaching philosophy is to develop philosophically literate students and to ensure that students develop philosophical literacy by design and not by chance. Perhaps the best method for teaching philosophy to beginning students is the public model, in which the practice of defending positions in the public arena forces students to become…

Recent information from established testing programs was used to investigate the nature and limitations of essay and multiple-choice tests of writing ability, the statistical relationship of these types of tests, the performance of population subgroups on each, the possible need of different disciplines for different tests of composition skill,…

Term papers written by 42 students in two subjects were assessed by their classmates and by lecturers in the relevant subjects. No difference occurred between lecturers and students in average marks, variations in marks, agreement in marks (reliability), or relationship between marks and performance in final examinations (validity). (Author/MSE)

In 1977, the Dallas, Texas Independent School District modified its teacher selection criteria. In addition to the previously used evaluation criteria involving transcripts, references and evaluations, three new measures were employed: (1) a test of verbal and quantitative ability, the Wesman Personnel Classification Test (WPCT), which was later…