There can be many reasons why students fail to answer correctly to summative tests in advanced computer science courses: often the cause is a lack of prerequisites or misconceptions about topics presented in previous courses. One of the ITiCSE 2020 working groups investigated the possibility of designing assessments suitable for differentiating…

Scores on the Test of English for International Communication Listening and Reading (TOEIC LR) have been used for rolling-based university admissions in South Korea. Because this test is not designed for that purpose by the testing organization, there may be a need to explore the validity of TOEIC LR score use for admission purposes. Accordingly,…

Employers, postsecondary institutions, and civic leaders are urging greater focus on 21st century skills essential for college, career, and civic success: problem solving, interpersonal skills, and collaboration, among others. In response to these demands, states across the country are working to realign policies--on learning standards,…

Accountability mandates often prompt assessment of student learning gains (e.g., value-added estimates) via achievement tests. The validity of these estimates have been questioned when performance on tests is low stakes for students. To assess the effects of motivation on value-added estimates, we assigned students to one of three test consequence…

Understanding attitudes toward science and measuring them remain two major challenges for science teaching. This article reviews the concept of attitudes toward science and their measurement. It subsequently analyzes the psychometric properties of the "Test of Science-Related Attitudes" (TOSRA), such as its construct validity, its…

The phrase "Education 3.0" is used to signal a complex and still-evolving paradigm shift from the traditional schooling models of the 19th and 20th centuries (Education 1.0), via an intensified focus on teachers' and school leaders' accountabilities in relation to students' learning (Education 2.0), towards a more holistic model of…

Critical thinking is an important outcome of a college education. Assessment techniques that require students to demonstrate their understanding of course concepts are referred to as authentic assessment and promote the development of critical thinking. Little research exists on the types of assessment and grading practices utilized by community…

Research on work as a calling is limited by measurement concerns. In response, the authors introduce the multidimensional Calling and Vocation Questionnaire (CVQ) and the Brief Calling scale (BCS), instruments assessing presence of, and search for, a calling. Study 1 describes CVQ development using exploratory and confirmatory factor analysis…

This technical report is designed to provide researchers with an overview of the design and implementation of the Teaching and Learning International Survey (TALIS) 2013. This information is meant to supplement that presented in OECD publications by describing those aspects of TALIS 2013 that are unique to the United States. Chapter 2 provides…

As a result of the Experiential Education Evaluation Project the publication identifies instruments used to measure and assess experiential learning programs. The following information is given for each instrument: rationale for its inclusion in the study; precise issues or outcomes designed to measure, validity and reliability data; and…

Suggests improvements for implementation of the "Views on Science-Technology-Society" instrument. Analyzes the scaling properties of some scoring procedures within the unique response model and discusses ways to produce "best fidelity" measurements. Presents a multiple-response model that could take advantage of all the…

Reports on a study in which students in a first-year engineering materials class were asked to grade their own examinations, and those of others. Comparisons were then made to the same papers graded by their teachers. (TW)

This volume, second in a series of five, focuses on methods to evaluate sex education programs. It is presented in five chapters. Chapter One critically reviews previously used methods of evaluating programs and makes suggestions for improving those evaluations. Problems of experimental designs which incorporate an experimental/control group and…

This journal issue addresses the issue of testing in the social studies classroom. The first article, "The Role of Testing" (Bragaw), focuses on the need for tests to reflect the objectives of the study completed. The varying functions of pop quizzes, weekly tests, and unit tests are explored. "Testing Thinking Processes" (Killoran, Zimmer, and…

This report summarizes conclusions from previous reports and makes explicit comparisons between assessment approaches. The report is organized in four sections under the headings: Design, Content Analysis, Costs, and Analysis of Technical Quality. The first section (Design) describes salient characteristics of each assessment approach, the…