Purpose: The purpose of this paper is to present a framework intended to guide students and novice researchers in learning about the necessary dimensions for assessing the rigour of qualitative research studies. The framework has four dimensions -- (T)rustworthiness, (A)uditability, (C)redibility and (T)ransferability. The development of TACT is…

Language assessment literacy (LAL), an increasingly prominent research topic, has generated substantial literature in language testing and assessment. Thus far, there seems to be few comprehensive reviews on this research topic. The current scoping study reviewed a total of 81 papers by synthesising LAL studies published from 2008 to 2020. It…

The aim of this research was to analyze and compare analytic rubric and general impression scoring in peer assessment. A total of 66 university students participated in the study and six of them were chosen as peer raters on a voluntary basis. In the research, students were supposed to prepare a sample study within the scope of scientific research…

In his proposal for comparative education, Marc Antoinne Jullien de Paris argues that the comparative method offers a viable alternative to the experimental method. In an experiment, the scientist can manipulate the variables in such a way that he or she can see any possible combination of variables at will. In comparative education, or in…

It is challenging to document the behavior changes that result from Extension programming. This article describes an evaluation method we call the "action items method." Unlike other approaches for measuring behavior change, this method requires program participants to define their own action plans as part of a program and then asks them…

Researcher--community partnerships are a necessary but not sufficient facet of effective research and evaluation with community-based projects and in clinical settings. This article describes two approaches that we have integrated into a multiyear, multiphase research and evaluation initiative supporting the health and well-being of vulnerable…

Visual expertise covers a broad range of types of studies and methodologies. Many studies incorporate some measure(s) of observer performance or how well participants perform on a given task. Receiver Operating Characteristic (ROC) analysis is a method commonly used in signal detection tasks (i.e., those in which the observer must decide whether…

In this paper, I discuss my engagement with a visual journal as a companion to creative research practice during my dissertation research. Grounded in arts based research methodologies; I explore visual journals in relationship to research, reflection and analytic processes. I begin with a discussion of the visual journal as an artifact of…

To begin statistical analysis, Bayesians quantify their confidence in modeling hypotheses with priors. A prior describes the probability of a certain modeling hypothesis apart from the data. Bayesians should be able to defend their choice of prior to a skeptical audience. Collaboration between evaluators and stakeholders could make their choices…

We discuss the articles of this special issue with reference to an important yet previously only implicit dimension of study quality: alignment across the theoretical and methodological decisions that collectively define an approach to self-regulated learning. Integrating and extending work by leaders in the field, we propose a framework for…

New technologies have led to several major advances in psychological research over the past few decades. Peer nomination research is no exception. Thanks to these technological innovations, computerized data collection is becoming more common in peer nomination research. However, computer-based assessment is more than simply programming the…

The work presented in this case study results from a study conducted in 2012-2014 examining a newly created teacher evaluation system to determine the inter-rater reliability of the classroom observation instrument. The teacher evaluation system was the result of a partnership between the school district and the university in the same city…

There is a contradiction in the literature about the effect of REACT strategy on science achievement. This study aims to resolve this contradiction by determining the effect of REACT strategy on student science achievement and the factors affecting this strategy by integrating findings obtained from both qualitative and quantitative studies. The…

With today's technology, Extension professionals have a variety of tools available for program evaluation. This article describes an innovative platform called VoiceThread that has been used in many classrooms but also is useful for conducting virtual focus group research. I explain how this tool can be used to collect qualitative participant…

This case study exemplifies the design of a formative evaluation project concerned with the implementation of a new school form in Austria. The purpose of this case study is to show how multiple methods were implemented in the research project NOESIS ("Niederösterreichische Schule in der Schulentwicklung"; Lower Austrian Middle School in…