The important yet under-researched role of item writers in the selection and adaptation of texts for high-stakes reading tests is investigated through a case study involving a group of trained item writers working on the International English Language Testing System (IELTS). In the first phase of the study, participants were invited to reflect in…

Feedback to the test taker is a defining characteristic of diagnostic language testing (Alderson, 2005). This article reports on a study that investigated how much and in what ways students at a Taiwan university perceived the feedback to be useful on an online multiple-choice diagnostic English grammar test, both in general and by students of…

"Participation"--defined as engagement in life situations, including leisure and recreational activities--is associated with the improvement of people with disabilities' quality of life. Several specific instruments assess leisure, but none of them has been adapted to the Spanish context. The goal of this study is to adapt and validate the Spanish…

The central goal of this study was to create a new diagnostic tool to identify organic chemistry students' alternative conceptions related to acid strength. Twenty years of research on secondary and college students' conceptions about acids and bases has shown that these important concepts are difficult for students to apply to qualitative problem…

It is well documented that many successful individuals are challenged by cognitive-based disabilities that impact their performance in school and on tests. While commonly believed to be related mostly to the constructs of processing speed or reading fluency, there are other aspects of cognition that affect how an individual interacts with the…

The Happiness Scale Interval Study deals with survey questions on happiness, using verbal response options, such as "very happy" and "pretty happy". The aim is to estimate what degrees of happiness are denoted by such terms in different questions and languages. These degrees are expressed in numerical values on a continuous…

While from a technological perspective Computer Supported Collaborative Learning (CSCL) systems have been improved considerably, previous studies have shown that the social aspect of the CSCL is often neglected or assumed to happen automatically by simply creating such virtual learning environments. By distinguishing between students' non-task…

Objectives: To carry out a preliminary exploration and measurement of therapy expectancy in adults with intellectual disabilities through the development and psychometric evaluation of the therapy expectation measure (TEAM). Design: The initial scale development phase combined top-down theory-driven and bottom-up data-driven processes to identify…

Validity evidence was gathered for the Academic Entitlement Questionnaire (AEQ). After reviewing entitlement literature, items were written to cover the breadth of academic entitlement. Results provide evidence for the substantive, structural, and external aspects of validity of the AEQ. Implications for research and use of the AEQ are discussed.…

Evaluators use their eyes to see what is there, whether it is intended or not. But they use their test instruments to measure what is intended, whether it is there or not. Evaluators have been broadening their repertoire of instruments for years: curriculum-embedded tests, observer checklists, audiotape recorders, videotape recorders, unobtrusive…

Although a number of instruments for assessing attitudes toward statistics have been developed, several questions with regard to the structure and item functioning remain unresolved. In this study, the structure of the Survey of Attitudes Toward Statistics (SATS-36), a widely used questionnaire to measure six aspects of students' attitudes toward…

Web-based standard setting holds promise for reducing the travel and logistical inconveniences of traditional, face-to-face standard setting meetings. However, because there are few published reports of setting standards via remote meeting technology, little is known about the practical potential of the approach, including technical feasibility of…

This paper investigated the current situation of oral English teaching, learning, and assessment at the tertiary level in China through needs analysis and explored the implications for the development of a diagnostic speaking test. Through random sampling, the researcher administered both a student questionnaire and a teacher questionnaire to over…

Independently learning from informative texts becomes increasingly important from the age of 11. Little information is available, however, on (a) how and to what extent late elementary education students already apply specific text-learning strategies, and (b) whether different learner profiles can already be distinguished. In this study, a…

The logic model that implicitly drives most professional development (PD) efforts asserts that PD leads to changes in teacher knowledge and beliefs, which leads to improved classroom practice, and ultimately, better student outcomes. However, efforts to study the impacts of PD programs are often hampered by the scarcity of high-quality…