We trained 9 behavioral staff members to conduct 2 brief preference assessments using 30-min video presentations that contained instructions and modeling. After training, we evaluated each staff member's implementation of the assessments in situ. Results indicated that 1 or 2 training sessions for each method were sufficient for teaching each…

Although it is widely accepted that procedural fidelity data are important for making valid decisions about intervention effectiveness, there is little empirical guidance for researchers and practitioners regarding how to assess procedural fidelity. A first step in moving procedural fidelity assessment research forward is to develop a…

Evaluators widely agree that stakeholder involvement is a central aspect of effective program evaluation. With the exception of articles on collaborative evaluation approaches, however, a systematic review of the breadth and depth of the literature on stakeholder involvement has not been published. In this study, we examine peer-reviewed empirical…

Responsive evaluation builds upon the methods of informal evaluation in disciplined ways: getting personally acquainted with the evaluand, observation of activities, interviewing people who are in different ways familiar with the evaluand, searching documents that reveal what happened in the past or somewhere else. It calls for sustained effort to…

We describe a system that automatically assembles test questions from a set of examples. Our system can create test questions appropriate for each user's level at low cost. In particular, when a user review their lesson, our system provides new test questions which are assembled based on their previous test results and past mistakes, rather than a…

Relying on teachers' assessments for the information currently provided by standardized test scores would save instructional time, better capture the true abilities of diverse students, and reduce the problem of teaching to the test. A California high school is implementing standards-based reporting, ensuring that teacher-issued grades function as…

Student rating instruments are recognised to be valid indicators of effective instruction, providing a valuable tool to improve teaching. However, free-form text comments obtained from the open-ended question component of such surveys are only infrequently analysed comprehensively. We employed an innovative, systematic approach to the analysis of…

In recent times there has been a major international push for giving voice to children in the provision of services for early education and development particularly among researchers and non-government organisations. However, what has been missing from this body of literature and activity is the children's perspective when centres and services are…

Science is a core discipline in academia yet the focus of most undergraduate technical writing is generally on the data and results, not the literature review. The Science, Technology, Engineering, and Math (STEM) librarian and a new geology professor at the University of Nebraska at Omaha (UNO) collaborated to develop an information literacy…

This paper presents the integration of a real time evaluation method of collaboration quality in a monitoring application that supports teachers in class orchestration. The method is implemented as an automatic rater of collaboration quality and studied in a real time scenario of use. We argue that automatic and semi-automatic methods which…

This article presents a case study on internationalization assessment. The international, intercultural and global dimensions at the school level are examined, focusing on the case of one particular secondary school in Israel. A novel, practical assessment tool is presented for the measurement of internationalization intensity and scope at the…

There are good reasons for higher education institutions to use learning analytics to risk-screen students. Institutions can use learning analytics to better predict which students are at greater risk of dropping out or failing, and use the statistics to treat "risky" students differently. This paper analyses this practice using…

This practice-sharing piece outlines two main approaches to flexible summative assessment schemes, including for each approach one example from my practice and another from a published study. The bento approach offers the same assessments to all students but a variety of grade weighting schemes, allowing students to change weighting during the…

This column provides original articles on innovations in case study teaching, assessment of the method, as well as case studies with teaching notes. This month's issue describes incorporating a journal article into the classroom by first converting it into a case study.

The relevance of the research problem is conditioned by the weak development of measurement, assessment of educational competences at an operational level, at the level of actions, by insufficient applications of psycho-pedagogical theories and methods of mathematical statistics. The aim of the work is to develop through teaching experiments the…