Background: Automatically graded programming assignments provide instant feedback to students and significantly reduce manual grading time for instructors. However, creating comprehensive suites of test cases for programming problems within automatic graders can be time-consuming and complex. The effort needed to define test suites may deter some…

A concept inventory is a standardized assessment tool intended to evaluate a student's understanding of the core concepts of a topic. In order to create a concept inventory it is necessary to accurately identify these core concepts. A Delphi process is a structured multi-step process that uses a group of experts to achieve a consensus opinion. We…

Describes how to construct questions to test all cognitive levels of learning for a course in introductory programming. The framework for learning is based on Bloom's taxonomy. Practical advice is given through examples and by describing a computer system to help deliver quizzes. Includes example questions. (Author/AEF)