The paper attempts to give an overview of evaluation in higher education institutions with particular emphasis on the faculties of humanities, education and social sciences disciplines at the University of Eswatini (Swaziland) in Southern Africa. It describes the general methodology of evaluation and identifies obstacles and relevant strategies…

Educationalists have had serious problems in proposing well-grounded ways of teaching critical thinking. Reviews of the field have called for research to develop theory concerning the learning experience associated with critical thinking enhancement, as well as to explore more tailored teaching and evaluation methods. This article suggests an…

Comparative Judgement (CJ) is an increasingly widely investigated method in assessment for creating a scale, for example of the quality of essays. One area that has attracted attention in CJ studies is the optimisation of the selection of pairs of objects for judgement. One approach is known as adaptive comparative judgement (ACJ). It has been…

The literature on Automated Essay Scoring (AES) systems has provided useful validation frameworks for any assessment that includes AES scoring. Furthermore, evidence for the scoring fidelity of AES systems is accumulating. Yet questions remain when appraising the scoring performance of AES systems. These questions include: (a) which essays are…

In this research report, we present an empirical argument for the use of a contributory scoring approach for the 2-essay writing assessment of the analytical writing section of the "GRE"® test in which human and machine scores are combined for score creation at the task and section levels. The approach was designed to replace a currently…

For the last century, the quality of large-scale assessment in the United States has been undermined by narrow educational theory and hindered by limitations in technology. As a result, poor assessment practices have encouraged low-level instructional practices that disparately affect students from the most disadvantaged communities and schools.…

Critical thinking is one of the most important skills deemed necessary for college graduates to become effective contributors in the global workforce. The first part of this article provides a comprehensive review of its definitions by major frameworks in higher education and the workforce, existing assessments and their psychometric qualities,…

In this paper, we provide an overview of psychometric procedures and guidelines Educational Testing Service (ETS) uses to evaluate automated essay scoring for operational use. We briefly describe the e-rater system, the procedures and criteria used to evaluate e-rater, implications for a range of potential uses of e-rater, and directions for…

To determine if quizzes containing higher order thinking questions are related to critical thinking and test performance when utilised in conjunction with an immersion approach to instruction and effort-based grading, sections of an "Educational Psychology" course were assigned to one of three quizzing conditions. Quizzes contained…

Automated Essay Scoring (AES) has garnered a great deal of attention from the rhetoric and composition/writing studies community since the Educational Testing Service began using e-rater[R] and the "Criterion"[R] Online Writing Evaluation Service as products in scoring writing tests, and most of the responses have been negative. While the…

Academic dishonesty is a major challenge facing educational institutions worldwide. Within the context of undergraduate education in the Arabian Gulf, oral assessment can help validate the originality of student work, whilst simultaneously facilitating assessment in a mode highly resonant with the region's own educational traditions and…

This work starts with a brief overview of education in developing countries, to contextualise the use of the guidelines. Although this document is intended to be a practical tool, it is necessary to include some theoretical analysis of the concept of online assessment. This is given in Sections 3 and 4, together with the identification and…

This study examined the effects of marking method and rater experience on ESL (English as a Second Language) essay test scores and rater performance. Each of 31 novice and 29 experienced raters rated a sample of ESL essays both holistically and analytically. Essay scores were analysed using a multi-faceted Rasch model to compare test-takers'…

The purpose of this case study is to document the ways in which fifth-grade students in a historically, low-performing school learned to write from a teacher who did not emphasize test-taking processes. The study demonstrates how these instructional practices in a writing workshop context positively affected the student performance on a statewide…

This is the story of a research journey that follows the trail of a novel evaluand--"place." I examine place as mentioned by rising juniors in timed exams. Using a hybridized methodology--the qualitative approach of a hermeneutic dialectic process as described by Guba and Lincoln (1989), and the quantitative evidence of place mention--I query…