Background: Draw-A-Scientist Test (DAST) has been one of the most used instruments to study conceptions of scientists and science. It has been especially useful for charting the conceptions of younger children who might lack the skills to express themselves in writing. However, recent studies suggest that instead of children's conceptions of the…

The subjective aspect of standard-setting is often criticized, yet data-driven standard-setting methods are rarely applied. Therefore, we applied a mixture Rasch model approach to setting performance standards across several testing programs of various sizes and compared the results to existing passing standards derived from traditional…

While much research has explored the quality of traditional teacher evaluations, little is known about the quality of ratings in preservice teacher evaluations. This paper presents a case study of Many-facet Rasch measurement (MFR, Linacre, 1989) to explore potential rater effects influencing the quality of supervisor ratings in educator…

Lecturers often claim that time constraints cause tension regarding feedback on students' assessment opportunities. Assessment strategies for effective feedback procedures can lead to early identification of problem areas in student performance. Numerous students at higher education institutions (HEIs) do not complete their qualifications or take…

Principles focused evaluation (PFE) can complement existing formative and outcome evaluation plans by identifying Effectiveness Principles (EPs), an operationalization of values and standards that guide practitioners during program implementation. To date, however, few examples of PFE are available in the literature. This description of the…

Multilingual summative assessments face significant challenges due to tensions that exist between multiple language provision and comparability. Yet, conventional approaches for investigating comparability in multilingual assessments fail to accommodate assessments that comprise extended responses that target complex constructs. This article…

Learning-oriented assessment has been called a practice that can be employed to increase the power of assessment practices in the classroom and one that has been said to promote efficient student learning. However, it is not always easy to employ learning-oriented assessment in English classes, because of a number of constraints. This study aimed…

Engaging students in creating learning resources has demonstrated pedagogical benefits. However, to effectively utilize a repository of student-generated content (SGC), a selection process is needed to separate high- from low-quality resources as some of the resources created by students can be ineffective, inappropriate, or incorrect. A common…

Background: Mainstream economic evaluations methods may not be appropriate to capture the range of effects triggered by interventions for people with intellectual disabilities. In this systematic review, we aimed to identify, assess and synthesise the arguments in the literature on how the effects of interventions for people with intellectual…

This research investigates the linkage between training evaluation, learning design and training transfer. A new training evaluation model, (i.e., learning-transfer evaluation model [LTEM]), was used to examine its ability to provide evaluative evidence through robust assessments in pre-, post- and delayed assessments. The model was used to…

Purpose: This paper illustrates how Guba and Lincoln's parallel criteria for establishing trustworthiness, can be adapted and applied to qualitative research on indigenous social protection systems. It provides insights for social protection researchers, exploring plausible qualitative research rigor evaluation criteria, on plausible alternatives.…

This article is based on studies carried out within the "Young children's learning" research education programme. This undertaking involved five graduate students, all recruited from the Swedish preschool system. The licentiate thesis makes up the final product of their education programme, and the focus of each candidate's licentiate…

The "consensual assessment technique" (CAT) represents one of the most popular evaluation techniques used by researchers to assess creative artifacts. In this paper we discuss how the prototypical use of the CAT, while useful for identifying unambiguous examples of creative artifacts, can inadvertently kill the curiosity of researchers…

To evaluate multidimensional factor structure, a popular method that combines features of confirmatory and exploratory factor analysis is Bayesian structural equation modeling with small-variance normal priors (BSEM-N). This simulation study evaluated BSEM-N as a variable selection and parameter estimation tool in factor analysis with sparse…

Design science research (DSR) is an appropriate method for postgraduate-level (MSc) thesis work, where the students need to combine and apply theoretical knowledge and hands-on skills to solve practical problems. Students face considerable challenges, however, when applying DSR in timeboxed situations with limited competences. In this paper, I…