Although school psychologists often comment on examinee motivation in their reports, systematic evaluation of effort is not common practice. Empirical assessment of performance effort provides critical evidence for the validity of evaluations and will likely lead to more valid assessments, recommendations, and placements. This article focuses on…

Quantitative measures of systematic differences in OSCE scoring across examiners (often termed examiner stringency) can threaten the validity of examination outcomes. Such effects are usually conceptualised and operationalised based solely on checklist/domain scores in a station, and global grades are not often used in this type of analysis. In…

The present research examined the role of metacognitive confidence in understanding to what extent people's valenced thoughts guide their performance in academic settings. First, students were asked to engage in positive or negative thinking about exams in their major area of study (Study 1) or about themselves (Studies 2 and 3). The valence of…

Comparative Judgement (CJ) is traditionally and primarily used to compare written texts. In this study we explored whether we could extend its use to comparing audio files. We used GCSE Music portfolios which contained a mix of audio recordings, musical scores and text documents. Fifteen judges completed two exercises: one comparing musical…

For psychoeducational evaluations to generate useful data, students must put forth sufficient effort on diagnostic tests, and they and their caregivers and teachers must respond honestly and carefully when asked about symptoms. These features are collectively known as response validity, a concept widely discussed in neuropsychological assessment…

Validity of performance standards is a key element for the defensibility of standard setting results, and validating performance standards requires collecting multiple pieces of evidence at every step during the standard setting process. This study employs a statistical procedure, latent class analysis, to set performance standards and compares…

Assessing student achievement over multiple years is complicated by students' memberships in shifting upper-level nesting structures. These structures are manifested in (1) annual matriculation to different classrooms and (2) mobility between schools. Failure to model these shifting upper-level nesting structures may bias the inferences…

The present study aimed to develop an analytic assessment rubric for the consecutive interpreting course in the educational setting in the Iranian academic context. To this end, the general procedure of rubric development, including data preparation, selection, and refinement, was applied. The performance criteria were categorized into content,…

The study established the validity and reliability of a weighted individual performance-based assessment tool within the utility scope of middle school orchestral strings. The following research questions guided this study: 1. What specific string-playing behaviors and corresponding criteria validate a weighted individual performance-based…

In this paper, we explore the role of mathematical proof summaries as a tool for capturing students' reading comprehension of a given proof. We present an interview study based on mathematicians' pairwise evaluations of student-produced summaries of a proof demonstrating the uncountability of the open unit interval. We present a thematic analysis,…

Internal and external factors influence teachers' daily assessment decisions. The purposes of teachers' assessments are crucial, as these purposes guide the assessment process. Still, little is known about teachers' assessment purposes. The aim of this study is to identify and describe the different purposes of assessments that Civics teachers…

Despite the enabling role of teacher feedback literacy in students' engagement with feedback, little empirical research has explored the internal structure of this construct and its influencing factors. This paper developed and validated a teacher feedback literacy scale for pre-service teachers and examined its influencing factors (i.e.…

School psychologists often have reason to suspect that students may not be putting forth full effort during diagnostic tests, or that questionnaire or rating scale data are not credible. However, such suspicions must be tested carefully to yield data-based conclusions. Structured, empirically supported methods for assessing the "response…

The rapid advancement of digital technology has not only affected the world of work but also students' learning. Digital learning competence (DLC) is one of the essential skills students need for effective learning in a digital environment. Despite the significant presence of secondary vocational school students in China, constituting one-third of…

Online learning is increasingly popular as the pandemic spreads around the globe. This shift in learning preferences presents opportunities and difficulties for the assessment of learning. As a method of assessment used throughout the learning process, formative assessment can encourage students' interest in learning, enhance learning outcomes,…