The Survey of Attitudes Toward Statistics (SATS) is a widely used family of instruments for measuring attitude constructs in statistics education. Since the development of the SATS instruments, there has been an evolution in the understanding of validity in the field of educational measurement emphasizing validation as an on-going process. While a…

The aim of this paper is to propose an analytical framework of disciplinary learning outcomes that will facilitate our understanding of the nature of disciplines and their relationships. Application of the draft analytical framework, Anderson and Krathwohl's "Taxonomy of Educational Objectives" to engineering learning outcome reference…

States and districts have expressed interest in administering the ACT® to 10th-grade students. Given that the ACT was designed to be administered in the spring of 11th grade or fall of 12th grade, the appropriateness of this use should be evaluated. As such, the focus of this paper is to summarize empirical evidence evaluating the use of the ACT…

In this article, Hartley notes the difficulties of using questionnaires to assess the efficiency of new instructional methods and highlights nine issues that researchers must consider. Hartley continues the discussion about the use of questionnaires and suggests that psychology teachers can help improve the teaching of psychology by drawing…

Achievement of advanced literacy as a goal of foreign language (FL) study within the available amount of time requires that FL departments construct a well-articulated program and optimize student learning at each stage of the curriculum. One essential element of such optimization is the development of assessment procedures to place students into…

Although there are tools to assess student's readiness in an "online learning context," little is known about the "psychometric" properties of the tools used or not. A systematic review of 5107 published and unpublished papers identified in a literature search on student online readiness assessment tools between 1990 and…

In this article we first summarise the main points raised by Morrow (1979) in the publication that formed the core of the Communicative Language Testing discussions at the original Language Testing Forum (1980). We take into consideration issues raised by the 1980 Forum participants when appropriate. We apply Morrow's ideas and issues emerging…

The scoring instrument described in this article is based on a deconstruction of the seven sections of an American Psychological Association (APA)-style empirical research report into a set of learning outcomes divided into content-, expression-, and format-related categories. A double-weighting scheme used to score the report yields a final grade…

Learners' feelings of social connectedness may be a key factor in predicting online course success. However, students attempting to perceive and process the social context in online courses often find themselves engaging in unfamiliar, technology-mediated communication channels. While there have been several empirically based strategies published…

Standardised testing has received a lot of political and public attention recently in Australia. This paper describes the sense-making of Year 3 students as they interpret items from the 2008 NAPLAN. Results show that student performance changed dramatically when the terminology of an item was modified and subsequently were not a true indication…

Survey data are widely used in higher education for purposes such as assessment and strategic planning. One of the most common ways of using surveys has been to assess student learning outcomes by means of proxy questions on a survey, assuming that students who engage in specific behaviors (called engagement) have learned more during college than…

This article uses the case of designing a new course questionnaire to discuss the issues of validity, reliability and diagnostic power in good questionnaire design. Validity is often not well addressed in course questionnaire design as there are no straightforward tests that can be applied to an individual instrument. The authors propose the…

The suitability of 52 items for measuring Blackboard course management system success was investigated with the aim of validating the Blackboard CMS success scale in an educational context. Through a survey, the Blackboard course management system (BCMS) success scale was administered to 503 students at the University of Botswana. Data collected…

This study investigates instructors' perceptions about strengths and weaknesses of a student ratings instrument employed in their university. The sample consisted of 357 instructors in a major Canadian university where each term students are required to complete an evaluation at the end of every course. Qualitative analyses of their written…

This paper reports on the development of a scale for determining the quality of the student e-learning experience at the degree level when the student learning context is predominately a campus-based experience. Rapid developments in the use of information and communication technologies (ICT) in higher education require methods for evaluating the…