The current study explores students' collaboration and problem solving (CPS) abilities using a human-to-agent (H-A) computer-based collaborative problem solving assessment. Five CPS assessment units with 76 conversation-based items were constructed using the PISA 2015 CPS framework. In the experiment, 53,855 ninth and tenth graders in Taiwan were…

In this study, it was aimed to determine the effect of Plickers, which is one of the Web 2.0 education tools, on success in affix-root teaching to 5th grade students. In the study, random design with pretest-posttest control group, which is one of the real trial models, was used. The study group of the study was determined by homogeneous sampling…

This study aims to examine the effectiveness of metacognitive scaffolding in different inquiry tasks related to optics. Two high school classes participated in this study. One class, the treatment group (n = 33), which integrated metacognitive prompts into the simulation-based inquiry, was compared to the other class, the control group (n = 34),…

Making inferences and reasoning with new scientific information is critical for successful performance in biology coursework. Thus, identifying students who are weak in these skills could allow the early provision of additional support and course placement recommendations to help students develop their reasoning abilities, leading to better…

Background: Of the myriad of reading comprehension (RC) assessments used in schools, multiple-choice (MC) questions continue to be one of the most prevalent formats used by educators and researchers. Outcomes from RC assessments dictate many critical factors encountered during a student's academic career, and it is crucial that we gain a deeper…

Detection of students' ability levels is one of the common aims in educational studies. Cognitive Diagnosis Modeling approach has been used recently for the purpose of ability level detection by defined Q-matrices. To evaluate students' strengths and weaknesses, determine their mastery skills, and design instructions and interventions in learning…

Geographic skills area major competency that must be developed through spatial thinking. This paper describes whether learning material questions about Geographic Information System (GIS) in geography textbooks contains components of spatial thinking: concepts of space, use of representation tools, and reasoning processes. This study uses a…

Distractor analyses are routinely conducted in educational assessments with multiple-choice items. In this research report, we focus on three item response models for distractors: (a) the traditional nominal response (NR) model, (b) a combination of a two-parameter logistic model for item scores and a NR model for selections of incorrect…

In the current study, we examined how student characteristics and cognitive skills, differing levels of text complexity (cohesion, decoding, vocabulary, and syntax), and reading comprehension question types (literal, inferential, critical analysis, and reading strategy) affected different types of reading outcomes (multiple-choice reading…

The current study was conducted to investigate whether test scores of Iranian English as Foreign Language (EFL) learners were equivalent across CBT and PBT modes, with 58 intermediate learners studying at a private language academy located in Behshahr city in northern Iran. Moreover, test takers' computer familiarity, attitudes, aversion, and…

Programmatic assessment is both a philosophy and a method for assessment. It has been developed in medical education as a response to the limitation of the dominant testing or measurement approaches and to better align with changes in how medical competence was conceptualised. It is based on continual collection of assessment and feedback…

The research purpose was to investigate the differences between learning preferences (i.e., Active-Reflective, Sensing-Intuitive, Visual-Verbal, and Sequential-Global) determined by the Index of Learning Style and gender (i.e., Male and Female) in regards to standardized achievement multiple-choice test performance determined by the Illinois Nurse…

Based on Afflerbach and Cho's (2009) theoretical model of Constructively Responsive Reading on the Internet (CRRI model), this study aims to explore the patterns of reading strategies that 40 proficient, college-level, Chinese English as a Foreign Language (EFL) learners use while reading online. It also seeks to identify the strategies' relations…

In 2014 Central Queensland University (CQU) in Australia banned the use of multiple choice questions (MCQs) as an assessment tool. One of the reasons given for this decision was that MCQs provide an opportunity for students to "pass" by merely guessing their answers. The mathematical likelihood of a student passing by guessing alone can…

The purpose of this study is to describe a methodology to recover the item model used to generate multiple-choice test items with a novel graph theory approach. Beginning with the generated test items and working backward to recover the original item model provides a model-based method for validating the content used to automatically generate test…