The number of complaints university lecturers make about a lack of knowledge, especially first-year students' procedural knowledge, has increased recently. Due to missing adequate empirical evidence, a survey of procedural knowledge among students of Austrian high schools in their final year was conducted. For this purpose, test items for…

Acquiescence is the tendency of participants to shift their responses to agreement. Lechner et al. (2019) introduced the following mechanisms of acquiescence: social deference and cognitive processing. We added their interaction into a theoretical framework. The sample consists of 557 participants. We found significant medium strong relationship…

Cognitive load studies are mostly centered on information on perceived cognitive load. Single-item subjective rating scales are the dominant measurement practice to investigate overall cognitive load. Usually, either invested mental effort or perceived task difficulty is used as an overall cognitive load measure. However, the extent to which the…

Previous research reveals that the visual design of open-ended questions should match the response task so that respondents can infer the expected response format. Based on a web survey including specific probes in a list-style open-ended question format, we experimentally tested the effects of varying numbers of answer boxes on several indicators…

Probes are follow-ups to survey questions used to gain insights on respondents' understanding of and responses to these questions. They are usually administered as open-ended questions, primarily in the context of questionnaire pretesting. Due to the decreased cost of data collection for open-ended questions in web surveys, researchers have argued…

Making metamemory judgments reactively changes item memory itself. Here we report the first investigation of reactive influences of making judgments of learning (JOLs) on interitem relational memory--specifically, temporal (serial) order memory. Experiment 1 found that making JOLs impaired order reconstruction. Experiment 2 observed minimal…

This study aims to evaluate exam questions set by science teachers for eighth grade students and science questions from a central high school entrance exam (HSEE) according to the Revised Bloom's Taxonomy (RBT). In this study, document analysis technique was employed, as one of the recognized methods of qualitative research. The HSEE science…

The compound Remote Associates Test (RAT) is a classic measure of creativity. Participants are shown three cue words (sore-shoulder-sweat) and asked to generate a word that connects them (cold). Theoretical views of RAT performance differ in the degree to which they conceptualize performance as depending on automatic spreading activation across…

Much of the focus of international comparative studies of students' achievement has been on New Zealand students' falling standards. Using the most recent findings from the Trends in International Mathematics and Science Study (TIMSS), and, in particular, Year 9 New Zealand students' performance in specific items, this article suggests that there…

Data from international large-scale assessments (ILSAs) of schooled populations indicate that boys have considerably poorer literacy skills than girls. New evidence from a household-based ILSA--Organisation for Economic Cooperation and Development Survey of Adult Skills (PIAAC)--indicates that the gender gap in literacy is negligible, even though…

The study focuses on assessing the proficiency levels of higher education students, specifically the physics achievement test (PHY 101) at the National Open University of Nigeria (NOUN). This test, like others, evaluates various aspects of knowledge and skills simultaneously. However, relying on traditional models for such tests can result in…

Response process data have the potential to provide a rich description of test-takers' thinking processes. However, retrieving insights from these data presents a challenge for educational assessments and educational data mining as they are complex and not well annotated. The present study addresses this challenge by developing a computational…

The aim of this study is to investigate the end-of-unit evaluation questions in 5th grade primary school science workbook according to dimensions of the Revised Bloom's Taxonomy (RBT). For that purpose, 191 end-of-unit evaluation questions of 5th grade science workbook which is approved by the Republic of Turkey -the Ministry of National…

This article presents preliminary analysis of a test item in a large-scale study design to promote the development of geometric reasoning progression. Two sets of data were analysed to validate the item designed to assess secondary school students' knowledge of a rectangle. The first data set involved 155 Year 4-10 students from seven trial…

This study reports on an Evidence Centered Design (ECD) project in the Netherlands, involving the theory exam for prospective car drivers. In particular, we illustrate how cognitive load theory, task-analysis, response process models, and explanatory item-response theory can be used to systematically develop and refine task models. Based on a…