Collaborative problem solving (CPS) is an important 21st-century skill for academic and career success, and as a result, there is increased interest among businesses and educational institutions in the assessment and development of CPS skills. CPS skills are difficult to measure using traditional forms of assessment, and that difficulty has led to…

Collaborative problem solving (CPS) is an important 21st-century skill for academic and career success, and as a result, there is increased interest among businesses and educational institutions in the assessment and development of CPS skills. CPS skills are difficult to measure using traditional forms of assessment, and that difficulty has led to…

The purpose of this study is to prepare a multiple-choice achievement test with high reliability and validity for the "Let's Solve the Puzzle of Our Body" unit. For this purpose, a multiple choice achievement test consisting of 46 items was applied to 178 fifth grade students in total. As a result of the test and material analysis…

This paper reports the results of a survey of 3006 Year 10-12 students on their understandings of metallic bonding. The instrument was developed based on Chi's ontological categories of scientific concepts and students' understanding of metallic bonding as reported in the literature. The instrument has two parts. Part one probed into students'…

Global progress has arisen from scientific advances and we currently live in the age of science, technology, engineering and mathematics (STEM); science as a way of increasing the knowledge base, technology as a means of manifesting the science, engineering as a way of building and creating with it, and mathematics to devise the language we use…

Much debate surrounds the issue of whether allowing candidates to listen to recordings twice is more desirable in language tests than offering just one opportunity. Using regression models, this study investigates, analyses and interconnects both item difficulty and stimulus length in relation to the frequency of stimulus presentation and its…

We evaluated the narrative and expository writing samples of 12 adolescents with language-learning disabilities (LLD) in Grades 6 to 12 for elements of microstructure (e.g., productivity, grammatical complexity) and macrostructure (genre-specific text structure elements) using an experimental measure. Writing samples were elicited with…

The potential of computer-based assessments for capturing complex learning outcomes has been discussed; however, relatively little is understood about how to leverage such potential for summative and accountability purposes. The aim of this study is to develop and validate a multimedia-based assessment of scientific inquiry abilities (MASIA) to…

In Learning Networks, learners need to share knowledge with others to build knowledge. In particular, when working on complex tasks, they often need to acquire extra cognitive resources from others to process a high task load. However, without support high task load and organizing knowledge sharing themselves might easily overload learners'…

Literature shows that feedback that is specific, immediate and goal-oriented is effective on (pre-service) teachers' performance. Synchronous coaching gives this kind of feedback. Due to immediateness of feedback, pre-service teachers can suffer from cognitive load. We propose a set of standardised keywords through which this performance feedback…

This technical report describes the process of development and piloting of reading comprehension measures that are appropriate for seventh-grade students as part of an online progress screening and monitoring assessment system, http://easycbm.com. Each measure consists of an original fictional story of approximately 1,600 to 1,900 words with 20…

For educational achievement tests that employ multiple-choice (MC) items and aim to reliably classify students into performance categories, it is critical to design MC items that are capable of discriminating student performance according to the stated achievement levels. This is accomplished, in part, by clearly understanding how item design…

The purpose of this study was to develop and gather validity evidence for silent reading fluency passages. A number of passages were written following a traditional story grammar structure (character, setting, events) and placed on a computer for students to read silently. We describe in detail, the manner in which content-related evidence was…

The purpose of this study was to document the instrument development of maze measures for grades 3-8. Each maze passage contained twelve omitted words that students filled in by choosing the best-fit word from among the provided options. In this technical report, we describe the process of creating, reviewing, and pilot testing the maze measures.…