This study examined the problems that pre-service teachers face in the online assessment process and their suggestions for solutions to these problems. The participants were 136 pre-service teachers who have been experiencing online assessment for a long time and who took the Foundations of Open and Distance Learning course. This research is a…

This study examines business students' learning and assessment under remote teachings during the COVID-19 pandemic in a well-established Finnish university. A survey method is used to collect information on 336 business students including 42 accounting students. As indicated by students' responses, a majority of the students succeeded in assessing…

Research has found that the "a"-stratified item selection strategy (STR) for computerized adaptive tests (CATs) may lead to insufficient use of high a items at later stages of the tests and thus to reduced measurement precision. A refined approach, unequal item selection across strata (USTR), effectively improves test precision over the…

Purpose: The purpose of this paper is to focus on assessing individuals' problems in learning groups/teams and should lead to the assessment of the group/team itself as a learning entity. Design/methodology/approach: In this paper, an extension of the IMS-Learning Design (IMS-LD) meta-model is proposed in order to support the assessment of…

This paper examines the construct measured by automated essay scoring (AES) systems. AES systems measure features of the text structure, linguistic structure, and conventional print form of essays; as such, the systems primarily measure text production skills. In the current state-of-the-art, AES provide little direct evidence about such matters…

This chapter addresses the psychometric challenges in assessing English language learners (ELLs) and students with disabilities (SWDs). The first section addresses some general considerations in the assessment of ELLs and SWDs, including the prevalence of ELLs and SWDs in the student population, federal and state legislation that requires the…

Cognitive ability tests are widely used in organizations around the world because they have high predictive validity in selection contexts. Although these tests typically measure several subdomains, testing is usually carried out for a single subdomain at a time. This can be ineffective when the subdomains assessed are highly correlated. This…

This article discusses how Information and Communication Technologies can support 21st century assessment strategies and what needs to be done to ensure that technological advances support and foster pedagogical innovation. Based on an extensive review of the literature, it provides an overview of current ICT-enabled assessment practices, with a…

Variable-length computerized adaptive testing (CAT) can provide examinees with tailored test lengths. With the fixed standard error of measurement ("SEM") termination rule, variable-length CAT can achieve predetermined measurement precision by using relatively shorter tests compared to fixed-length CAT. To explore the application of…

This paper first presents an overview of the concepts of assessment and evaluation in Open and Distance Learning (ODL) environment. The large numbers of students and numerous courses make assessment and evaluation very difficult and administrative nightmare at Distance Learning (DL) institutions. These challenges informed exploring issues relating…

This article investigates several questions regarding the impact of different item formats on measurement characteristics. Constructed response (CR) items and multiple choice (MC) items obviously differ in their formats and in the resources needed to score them. As such, they have been the subject of considerable discussion regarding the impact of…

On a general level, the objective of diagnostic classifications models (DCMs) lies in a classification of individuals regarding multiple latent skills. In this article, the authors show that this objective can be achieved by multidimensional adaptive testing (MAT) as well. The authors discuss whether or not the restricted applicability of DCMs can…

Quality assurance in instructional development demands an exhaustive formative evaluation effort and applied testing. Unfortunately, this process is expensive and requires large numbers of user testers with characteristics similar to the intended audience. This article presents a procedure for increasing the efficiency of quality assurance efforts…

Over the past several decades, a wider range of assessment strategies has gained prominence in classrooms, including complex assessment items such as individual or group projects, student journals and other creative writing tasks, graphic/artistic representations of knowledge, clinical interviews, student presentations and performances, peer- and…

This experiment involved college students (N = 464) working on an authentic learning task (writing an essay) under 3 conditions: no feedback, detailed feedback (perceived by participants to be provided by the course instructor), and detailed feedback (perceived by participants to be computer generated). Additionally, conditions were crossed with 2…