This study investigated the performance of four widely used data-collection designs in detecting test-mode effects (i.e., computer-based versus paper-based testing). The experimental conditions included four data-collection designs, two test-administration modes, and the availability of an anchor assessment. The test-level and item-level results…

Based on concerns about the item response theory (IRT) linking approach used in the Programme for International Student Assessment (PISA) until 2012 as well as the desire to include new, more complex, interactive items with the introduction of computer-based assessments, alternative IRT linking methods were implemented in the 2015 PISA round. The…

The present study examined the measurement properties of the Emotional and Behavioral Screener (EBS), a universal screening instrument which identifies students presenting with emotional and behavioral problems. The primary research questions sought to examine the degree to which the EBS item responses fit the Rasch model through evaluating fit of…

The purpose of this research was to measure the reasoning skills of mathematics students using a test instrument developed from mathematics routine and non-routine task. The study used research and development method. Development of the instrument and measurement of mathematical reasoning skills using procedure: items preparation (modification…

The findings of previous research into the compatibility of stakeholders' perceptions with statistical estimations of item difficulty are not seemingly consistent. Furthermore, most research shows that teachers' estimation of item difficulty is not reliable since they tend to overestimate the difficulty of easy items and underestimate the…

In this research, it is aimed to develop a valid and reliable test to determine the drawing a shape-schema and making a table levels of prospective teachers at Mathematics and Science Education, Turkish and Social Sciences Education and Basic Education Departments. In this process, a comprehensive item pool has been prepared with the table of…

Sound assessment tools are needed to evaluate effects of mathematics interventions that familiarize children with early mathematics concepts before they enter the formal school system. We developed a short version of an existing early mathematics tool based on analyses of data collected in a nationally representative Danish sample. Research…

Using a multiphase approach, the purpose of the present study was to develop a psychometrically sound questionnaire to measure protégés' perceptions of peer athlete mentoring functions. Phase 1 consisted of three stages: (a) item development, (b) assessment of content validity via think-aloud interviews with peer mentored athletes, and (c)…

The purpose of this study was to adapt the Elementary Teachers Efficacy and Attitudes towards STEM Survey (ET-STEM scale; Friday Institute for Educational Innovation, 2012) into Turkish and test the validity and reliability of the instrument. ET-STEM was administered to 313 elementary teachers from different provinces of Turkey. Exploratory and…

Mathematics and spatial reasoning are inextricably linked. While this is increasingly recognised, a clearer understanding of how spatial reasoning improves your mathematics performance is needed. We sought to explore the role of spatial reasoning strategy use across a range of mathematics assessment tasks with Grade 7 and 9 students. Interviews…

Since 1973, the National Assessment of Educational Progress (NAEP) has gathered information about student achievement in mathematics. The NAEP assessment in mathematics has two components that differ in purpose. One assessment measures long-term trends in achievement among 9-, 13-, and 17-year-old students by using the same basic design each time.…

This three-paper dissertation explores item cluster-based assessments, first in general as it relates to modeling, and then, specific issues surrounding a particular item cluster-based assessment designed. There should be a reasonable analogy between the structure of a psychometric model and the cognitive theory that the assessment is based upon.…

The research shared in this conference paper report illustrates how an iterative process to item development that involves expert review and cognitive lab interviews with students can be used to collect evidence of validity for assessment items. Analysis of students' reasoning was also used to expand a model for identifying conceptions and…

This research aims to produce feasible and valid assessment instrument of Higher Order Thinking Skill (HOTS) to measure students' Higher Order Thinking Skill in Physics learning. The type of this research was research and development, adapted from development model from Brog and Gall. The researchers modified Borg and Gall's development model as…

To be familiar with micro and symbolic performances, students could work out more effective approaches of innovated techniques known as five hierarchical designs in chemistry equilibrium. However, the most frequently reported problem in students' assessment of chemistry study is attributed to their poor skill recognizing basic concepts. The aim of…