Solving non-routine problems is a key competence in a world full of changes, uncertainty and surprise where we strive to achieve so many ambitious goals. But the world is also full of solutions because of the extraordinary competences of humans who search for and find them. We must explore the world around us in a thoughtful way, acquire knowledge…

This paper briefly discusses four measurement challenges of data science or "big data" in educational assessments that are enabled by technology: 1. Dealing with change over time via time-based data. 2. How a digital performance space's relationships interact with learner actions, communications and products. 3. How layers of…

Complex Problem Solving (CPS) skills are essential to successfully deal with environments that change dynamically and involve a large number of interconnected and partially unknown causal influences. The increasing importance of such skills in the 21st century requires appropriate assessment and intervention methods, which in turn rely on adequate…

This paper considers uses of technology in educational assessment from the perspective of innovation and support for teaching and learning. It examines assessment cases drawn from contexts that include large-scale testing programs as well as classroom-based programs, and attempts that have been made to harness the power of technology to provide…

The 21st-century work environment places strong emphasis on nonroutine transversal skills. In an educational context, complex problem solving (CPS) is generally considered an important transversal skill that includes knowledge acquisition and its application in new and interactive situations. The dynamic and interactive nature of CPS requires a…

The purpose of this randomized experiment was to compare the performance of high-, average-, and low-achieving middle school students who were assessed with parallel versions of a computer-based test (CBT) or a paper-pencil test (PPT). Tests delivered in interactive, immersive environments like the CBT may have the advantage of providing teachers…

Educational institutions are considered as main indicator of a nation's competitiveness and the excellence of implementing their goals and objectives increase a nation's sense of competitiveness. Thus, it is important to receive a progress report showing how close the educational institutions are in accomplishing the 21st century visions and…

This paper considers three areas related to the testing of minimum knowledge and skills: public policy, the nature of higher-order thinking and selected aspects of educational measurement. The discussion of public policy issues centers around an apparent dichotomy of egalitarianism and elitism in public education, schooling and the public economy,…

Postsecondary level remediation has recently received a great deal of attention with the public questioning the efficacy of spending money on remedial classes, and scholars questioning whether such courses are effective in helping students graduate. The California State University (CSU) system has responded to the challenge of remediation by…

Much like the shifting landscape in K-12 educational technology, this year's "Technology Counts" issue is changing to address the challenges of covering schools in the digital age. The 2010 report does not issue state report cards or state policy reports. Instead, the report takes a more district- and school-level look at educational…

In assessing the quality of science teaching for an effort such as the National Assessment of Educational Progress (NAEP), it is important to understand what is meant by scientific thinking--the search for explanations. Instruction should involve higher-order cognitive skill development, but it is difficult to measure reasoning and understanding…

Discusses the need for researchers to determine what should be tested and how when evaluating educational computing programs, describes efforts of Educational Testing Service's National Assessment of Educational Progress (NAEP) to measure the impact of computers on achievement, and concludes that it will not be easy to evaluate computers' effects.…

This paper reports a study aimed at revealing special-educational-needs pupils' learning potential by means of an ICT-based assessment including a dynamic visual tool that might help pupils when solving mathematics problems. The study focused on subtraction problems up to 100, which require "borrowing". These problems, in which the value…

This is a condensed report of a study commissioned by the Minister's Advisory Committee on Student Achievement (MACOSA). The study was designed to provide information about current levels of achievement in mathematics among students in Alberta schools and to provide a data base for future assessments. The test was given to third-, sixth-, ninth-,…

The articles in this annotated bibliography represent holdings of the Test Center in the area of assessment alternatives in mathematics. Presence on the list does not imply endorsement of the practices by the Test Center; rather, articles are made available to stimulate thinking and provide ideas. Some entries present informal assessments intended…