This study aimed to investigate the item "Response Time Fidelity scores" ("RTFs"), "KuderRichardson Reliability" ("KR[subscript 20]") and "Cronbach's Alpha Reliability" ("alpha") coefficients, calculate "KR[subscript 20]" coefficients with "RTFs" for 30 threshold…

We provide evidence of validity for a newly developed diagnostic competence model of operation sense, by both (a) describing the theoretically substantiated development of the competence model in close association with its use within a large-scale formative assessment and (b) providing empirical evidence for the theoretically described cognitive…

This study investigates patterns exhibited by pre-service teachers (PSTs) while practicing feedback in response to students' solutions on a procedure-based mathematics assessment. First, we developed an analytical framework for understanding mathematics PSTs' written feedback. Second, we looked into how a learning module on a multimedia platform…

Detection of differential item functioning (DIF) by use of the logistic modeling approach has a long tradition. One big advantage of the approach is that it can be used to investigate nonuniform (NUDIF) as well as uniform DIF (UDIF). The classical approach allows one to detect DIF by distinguishing between multiple groups. We propose an…

The purpose of this study was to construct a holistic education school evaluation tool using Montessori Erdkinder principles, and begin the validation process of examining the proposed tool. This study addresses a vital need in the holistic education community for a school evaluation tool. The tool construction process included using Erdkinder…

This research combines work in memory, retrieval practice, and depth of processing research. This work aims to identify how the format and depth of a retrieval practice item can be manipulated to increase the effort required to successfully recall or formulate an answer, with the hypothesis that if the effort required to answer an item is…

The present study set out to explore the locus of the poorly understood but frequently reported and comparatively large practice effect in sustained attention tests. Drawing on a recently proposed process model of sustained attention tests, several cognitive tasks were administered twice in order to examine which specific component of test…

Our study is on developing mathematics items for Computer-Based Testing (CBT) using Tablet PC. These items are subject-based items using interactive dynamic objects. The purpose of this study is to obtain some suggestions for further tasks drawing on field test results for developed items. First, we clarified the role of the interactive dynamic…

Although researchers argue that studying semantically related words simultaneously (semantic clustering) inhibits vocabulary acquisition, recent studies have yielded inconsistent results. This study examined the effects of semantic clustering while addressing the limitations of previous studies (e.g., confounding of semantic relatedness with other…

Cross-linguistic lexical similarity in the form of cognates and loanwords has been shown to positively impact second language learning and use, as well as performance on tests of lexical knowledge, even when the learners' languages differ in script. The present study utilizes Japanese cognate frequency, as an indication of cognate knowledge, to…

The purpose of this study is to describe, critically analyse and discuss the Swedish system of assessing ethics education in compulsory school through national tests. The publicly available tests from 2013 for grades six and nine have been studied as have the assessment instructions for teachers. Staff responsible for the test construction have…

The central purpose of this paper is to examine validity problems arising from the multiple-choice items and technical passages in the Test of English as a Foreign Language Internet-based Test (TOEFL iBT) reading section, primarily concentrating on construct-irrelevant variance (Messick, 1989). My personal TOEFL iBT experience, along with my…

Graded Response Method (GRM) is an alternative to multiple-choice testing where students rank options according to their relevance to the question. GRM requires discrimination and inference between statements and is a cost-effective critical thinking assessment in large courses where open-ended answers are not feasible. This study examined…

Dealing with multiple external representations (MERs) in science education is the key to students' understanding of science communication and becoming scientifically literate. It is generally accepted that learning scientific concepts, processes, and principles requires understanding and interacting with MERs. Science can be understood as a…

This paper explains the rationale for updating the OECD Programme for International Student Assessment (PISA) 2021 questionnaire on Information and Communication Technology (ICT) and shows how it covers policy topics of current relevance. After presenting key findings based on previous ICT-related PISA data, the paper provides a summary of the…