Solving non-routine problems is a key competence in a world full of changes, uncertainty and surprise where we strive to achieve so many ambitious goals. But the world is also full of solutions because of the extraordinary competences of humans who search for and find them. We must explore the world around us in a thoughtful way, acquire knowledge…

Designing, developing, and administering assessments has remained fairly unchanged across the past century. However, recent developments in instructional technology, learning science theory, and advances in the design of assessments necessitate a newfound perspective on assessment. The objective of the present article is to review the topic of…

Automatic coding of short text responses opens new doors in assessment. We implemented and integrated baseline methods of natural language processing and statistical modelling by means of software components that are available under open licenses. The accuracy of automatic text coding is demonstrated by using data collected in the "Programme…

Although International Association for the Evaluation of Educational Achievement-pioneered international large-scale assessment (ILSA) of education is now a well-established science, non-practitioners and many users often substantially misunderstand how large-scale assessments are conducted, what questions and challenges they are designed to…

This paper briefly discusses four measurement challenges of data science or "big data" in educational assessments that are enabled by technology: 1. Dealing with change over time via time-based data. 2. How a digital performance space's relationships interact with learner actions, communications and products. 3. How layers of…

Curriculum-based measurement in reading (CBM-R) and the Measures of Academic Progress (MAP) are assessment tools widely employed for universal screening in schools. Although a large body of research supports the validity of CBM-R, limited empirical evidence exists supporting the technical adequacy of MAP or the acceptability of either measure for…

Serious Educational Games (SEGs) have been a topic of increased popularity within the educational realm since the early millennia. SEGs are generalized form of Serious Games to mean games for purposes other than entertainment but, that also specifically include training, educational purpose and pedagogy within their design. This rise in popularity…

The No Child Left Behind Act resulted in increased school-level implementation of assessment-based school interventions that aim to improve student performance. Diagnostic assessments are included among these interventions, designed to help teachers use evidence about student performance to modify and differentiate instruction and improve student…

Describes evolving trends in testing, including such topics as formative versus summative evaluations; the use of tests as a guide to instructional decision making; the need to focus on higher level cognitive skills; and the role of computers in testing. An annotated bibliography lists 10 relevant journal articles. (CLB)

The current technology of computerized testing is discussed, and a few comments are made on how such technology might be used for assessing school-related skills as part of the National Assessment of Educational progress (NAEP). The critical feature of computerized assessment procedures is that the test items are presented in interactive fashion,…

Different kinds of tests are given to determine student achievement. Standardized achievement tests are often used, but have many limitations. They may be useful in determining the content students should learn and its relevance for future learning and the curriculum. Criterion referenced tests eliminate a major weakness of standardized tests in…

The potential value of developing item banks that would both guarantee the quality of teacher-made examinations and allow for national comparison of student achievement is described. Use of Rasch model methods, rather than classical item analysis techniques, to calibrate the items for these banks is illustrated. (BS)

With pressure to find more cost effective and less labor-intensive approaches to testing, states are seeing computer-based testing as a way to address the increasingly challenging prospect of assessing all students in a state at nearly all grades. Unfortunately, most states have not specifically considered the needs of students with disabilities.…

The development of a hypothetical testing program designed to provide optimum information about student achievement is chronicled. Computer adaptive testing and performance testing are postulated as part of the program. What optimum information really means is discussed. Optimum is only optimal when theory and application are balanced. (SLD)

Guidelines, practical suggestions, and examples are offered to assist teachers in planning and developing tests to accurately measure student achievement. The six chapters cover: (1) planning tests; (2) developing tests; (3) assembling and administering tests; (4) interpreting test results; (5) assessing test items; and (6) improving test validity…