Background: The current study aimed to validate the utility of previously established validity indicators derived from MOXO-d-CPT's continuous performance test. Method: Healthy simulators feigned impairment after searching online for relevant information, an ecologically valid coaching condition (n = 39). They were compared to ADHD patients (n =…

PISA is an extremely influential large-scale assessment, and its "policy lessons" are being incorporated in a range of nations all over the world. In this paper I argue that not only is PISA influencing policies and practices, but also that "seeing like PISA" is becoming a widespread phenomenon. Globally, education…

Student evaluation of teaching (SET) is now commonplace in many universities internationally. While much effort has been devoted to examining the statistical validity of SET instruments, there has been limited examination of the methodological and consequential validity (together referred to as "utility") of the ways in which SET data…

Organizational evaluation capacity building has been a topic of increasing interest in recent years. However, the actual dimensions of evaluation capacity have not been clearly articulated through empirical research. This study sought to address this gap by identifying the key dimensions of evaluation capacity in Canadian federal government…

Principals and teachers do not use large-scale assessment results because the lack of distinct and reliable subtests prevents identifying strengths and weaknesses of students and instruction, the results arrive too late to be used, and principals and teachers need assistance to use the results to improve instruction so as to improve student…

Few arguments about education are as effective at galvanizing public attention and motivating political action as those that compare the performance of students with their counterparts in other countries and that connect academic achievement to economic performance. Because data from international large-scale assessments (ILSA) have a powerful…

This study investigates instructors' perceptions about strengths and weaknesses of a student ratings instrument employed in their university. The sample consisted of 357 instructors in a major Canadian university where each term students are required to complete an evaluation at the end of every course. Qualitative analyses of their written…

A reorganized version of standards to be utilized for those who are involved with educational evaluation in Brazil was the result of a critical review of evaluation standards which were originally elaborated by the Joint Committee on Standards for Educational Evaluation. The conceptual framework for the critical review comprised logical…

Psychological methods of assessing intelligence have been criticised because of their limited diagnostic-remedial nature and especially their lack of potential for initiating effective and pragmatic intervention programmes. Similarly, the means through which the results of such methods are communicated in order to make them useful and constructive…

Developed a needs-assessment model and validated the model with five groups of stakeholders connected with an undergraduate university nursing program in Canada. Used focus groups, questionnaires, a hermeneutic approach, and the magnitude-estimation scaling model to validate the model. Results show that respondents must define need to clarify the…

A model for evaluation of complex educational settings is proposed. The model covers measurement, judgment, and decision making and the related criteria of reliability, validity, and utility. A second proposed model depicts the provincial educational setting. The development of a provincial item bank illustrates the application of the models. (TJH)

This paper examines possible explanations for the fact that evaluation results are rarely used. Most explanatory factors for use of results in decision making mentioned in the literature have been clustered in three categories of variables. They concern: (1) the making of decisions about the practical problem; (2) the way in which evaluation is…

A survey identified 352 psychological tests that are used in Australia but produced in other countries. About 89 percent have been standardized for use in Australia, but no local data have been compiled for some high-use tests. Responsibilities of test distributors and users are discussed. (SLD)