Assessment and institutional research offices have too much data and too little time. Standard reporting often crowds out opportunities for innovative research. Fortunately, advancements in data science now offer a clear solution. It is equal parts technique and philosophy. The first and easiest step is to modernize data work. This column…

The Centre for Evaluation and Monitoring (CEM), based in the North of England, recently celebrated its 40th birthday. Arising from an evaluation project at Newcastle University, and a subsequent move to Durham University, it rapidly grew in scope and influence, developing a series of highly regarded school assessments. For a relatively small…

Research projects involving science shops and citizen science in their promotion of participatory approaches are flourishing globally. However, an instrument evaluating the impacts of such approaches at different stages of a participatory research processes has yet to be validated. The InSPIRES H2020 project developed an impact evaluation tool for…

Historically, organizational researchers have fully embraced frequentist statistics and null hypothesis significance testing (NHST). Bayesian statistics is an underused alternative paradigm offering numerous benefits for organizational researchers and practitioners: e.g., accumulating direct evidence for the null hypothesis (vs. 'fail to reject…

COVID-19 significantly contributed to increasing use of online assessment in education, including physical education. Teachers still need online assessments in face-to-face learning because they help them improve a practical, objective, and credible assessment process for students' learning performance. This research aimed at tracking the…

In recent years, online learning has received more attention than ever before. One of the most challenging aspects of online education is the students' assessment since academic integrity could be violated due to various cheating behaviors in online examinations. Although a considerable number of literature reviews exist about online learning,…

Q methodology (Q) offers a scientific way to study subjectivity, meaning people's viewpoints about a topic. The underlying assumption of Q is that when people share an experience, they do not necessarily form the same viewpoint about that experience. This is different from the use of Likert-scale surveys that report results using aggregate…

This bibliometric analysis attempts to map out the scientific literature on automated writing evaluation (AWE) systems for teaching, learning, and assessment. A total of 170 documents published between 2002 and 2021 in Social Sciences Citation Index journals were reviewed from four dimensions, namely size (productivity and citations), time…

This case study is a demonstration of how an ethnographic study can be adapted to an online survey due to circumstantial challenges such as the COVID-19 pandemic. The researchers were the Director of Ed.D. and 11 doctoral students in a doctoral emphasis called Transformative Learning in the Global Community. The objective was to explore the social…

Using item-response theory to model rater effects provides an alternative solution for rater monitoring and diagnosis, compared to using standard performance metrics. In order to fit such models, the ratings data must be sufficiently connected in order to estimate rater effects. Due to popular rating designs used in large-scale testing scenarios,…

Computer-based assessment (CBA) is a top-rated tool for conducting assessments, mapping learning outcomes, and selecting new candidates. Research that examines the development and use of CBA is also increasing from year to year, so without bibliometric analysis, it would be quite challenging to keep up with all of these studies. This study aims to…

With the introduction of a new initiative in a teaching and learning environment there is an ethical responsibility to consider whether the impact of the introduction has met its intended goals, and whether it has harmed those who are influenced by it. Technology and infrastructure developments have encouraged a continued growth in the development…

There have been giant leaps in the field of education in the past 1-2 years. Schools and colleges are transitioning online to provide more resources to their students. The COVID-19 pandemic has provided students more opportunities to learn and improve themselves at their own pace. Online proctoring services (part of assessment) are also on the…

Purpose: Anomia, or word-finding difficulty, is a prevalent and persistent feature of aphasia, a neurogenic language disorder affecting millions of people in the United States. Anomia assessments are essential for measuring performance and monitoring outcomes in clinical settings. This study aims to evaluate the reliability of response time (RT)…

This research aims to determine the strengths and weaknesses of the online exams, as well as the aspects that can be evaluated as opportunities and threats, by making a SWOT analysis of the online exams that are frequently used in the distance education process. For this purpose, the study was designed with the case study technique, one of the…