There can be many reasons why students fail to answer correctly to summative tests in advanced computer science courses: often the cause is a lack of prerequisites or misconceptions about topics presented in previous courses. One of the ITiCSE 2020 working groups investigated the possibility of designing assessments suitable for differentiating…

Scores on the Test of English for International Communication Listening and Reading (TOEIC LR) have been used for rolling-based university admissions in South Korea. Because this test is not designed for that purpose by the testing organization, there may be a need to explore the validity of TOEIC LR score use for admission purposes. Accordingly,…

Employers, postsecondary institutions, and civic leaders are urging greater focus on 21st century skills essential for college, career, and civic success: problem solving, interpersonal skills, and collaboration, among others. In response to these demands, states across the country are working to realign policies--on learning standards,…

Accountability mandates often prompt assessment of student learning gains (e.g., value-added estimates) via achievement tests. The validity of these estimates have been questioned when performance on tests is low stakes for students. To assess the effects of motivation on value-added estimates, we assigned students to one of three test consequence…

Understanding attitudes toward science and measuring them remain two major challenges for science teaching. This article reviews the concept of attitudes toward science and their measurement. It subsequently analyzes the psychometric properties of the "Test of Science-Related Attitudes" (TOSRA), such as its construct validity, its…

The phrase "Education 3.0" is used to signal a complex and still-evolving paradigm shift from the traditional schooling models of the 19th and 20th centuries (Education 1.0), via an intensified focus on teachers' and school leaders' accountabilities in relation to students' learning (Education 2.0), towards a more holistic model of…

Critical thinking is an important outcome of a college education. Assessment techniques that require students to demonstrate their understanding of course concepts are referred to as authentic assessment and promote the development of critical thinking. Little research exists on the types of assessment and grading practices utilized by community…

Research on work as a calling is limited by measurement concerns. In response, the authors introduce the multidimensional Calling and Vocation Questionnaire (CVQ) and the Brief Calling scale (BCS), instruments assessing presence of, and search for, a calling. Study 1 describes CVQ development using exploratory and confirmatory factor analysis…

This technical report is designed to provide researchers with an overview of the design and implementation of the Teaching and Learning International Survey (TALIS) 2013. This information is meant to supplement that presented in OECD publications by describing those aspects of TALIS 2013 that are unique to the United States. Chapter 2 provides…