Background: Base-ten thinking (BTT) -- children's ability to reason in tens and ones is a crucial measure of Foundation Phase learners' mathematical performance in South Africa. Aim: The study looks at the six learners using BTT to solve additive tasks through two different assessments. Setting: Six purposely selected Grade 3 learners in…

This paper presents evidence of the score reliability, factor structure, criterion-related validity, and measurement equivalence of a web-based assessment of several important social and emotional competencies for children in fourth through sixth grades. The assessment, SELweb LE (Late Elementary), is designed to measure children's understanding…

The relationship between the characteristics of 33 mathematical problem-solving questions answered by 16-year-old students in England and the quality of problem-solving elicited was investigated in two studies. The first study used comparative judgement (CJ) to estimate the quality of the problem-solving elicited by each question, involving 33…

Educators and policymakers envision the future of education in Egypt as enabling learners to acquire scientific inquiry and problem-solving skills. In this article, we describe the validation of a model for problem solving and the design of instruments for evaluating new teaching methods in Egyptian science classes. The instruments were based on…

People use external knowledge representations (KRs) to identify, depict, transform, store, share, and archive information. Learning how to work with KRs is central to be-coming proficient in virtually every discipline. As such, KRs play central roles in curriculum, instruction, and assessment. We describe five key roles of KRs in assessment: (1)…

The aim of the present study was to develop an on-line assessment system with constructed response items in the context of elementary mathematics curriculum. The system recorded the problem solving process of constructed response items and transfered the process to response codes for further analyses. An inference mechanism based on artificial…

This study investigated the use of performance-confidence relationships to signal the presence of alternative conceptions and inadequate problem-solving skills in mechanics. A group of 33 students entering physics at a South African university participated in the project. The test instrument consisted of 20 items derived from existing standardised…

To assess students' developing literacy, teachers regularly listen as individuals read. Similarly, listening to students talk about their mathematical reasoning is a powerful way for teachers to assess students' problem-solving abilities and mathematical understanding. Traditional paper-and-pencil tests have long been the main avenue to evaluate…

Explains the importance of problem solving and critical thinking for scientific literacy and discusses assessment strategies to evaluate student problem solving. (YDS)

The Bookmark standard-setting procedure was developed to address the perceived problems with the most popular method for setting cut-scores: the Angoff procedure (Angoff, 1971). The purposes of this article are to review the Bookmark procedure and evaluate it in terms of Berk's (1986) criteria for evaluating cut-score setting methods. The…

The purpose of this report is to describe the development of a pool of mathematical problem-solving situations and a set of items for each situation which provides information about students' qualitatively different levels of reasoning ability as applied to that situation. For each problem-solving situation, a set of "structured…

A previous study of new item types for the analytical measure of the Graduate Record Examinations (GRE) General Test found that the new items had many factors labeled verbal reasoning, informal reasoning, formal-deductive reasoning, and quantitative reasoning. The present study examined how processing differed for these item types in the context…

A new system of order analysis, developed by Takeya and called Item Relations Structure Analysis (IRSA), was described and used for examining the structural relations among a set of 24 items on the addition and subtraction of fractions. A diagraph showing 16 chains of items that had discernibly common features was generated by this method, and…

The IRT (Item Response Theory) has been studied and applied in computer-based test for decades. However, almost of all these existing studies evaluated focus merely on test questions with text-based (or static text/graphic) type of presentation form illustrated exclusively. In this paper, we present our study on test questions using both…

We report on a study of what happened when we recycled a conceptual examination question in a first-year university physics course. The question, which was used for three consecutive years, asked about an astronaut's experience of weighing in an orbiting space-craft. The original intention was to use a phenomenographic approach to look for…