This article presents the Renger System Test (RST) as a method for assessing whether a system evaluation approach is suitable for evaluating complex interventions. The RST has three criteria: (1) the intervention includes multiple components, (2) these components operate interdependently, and (3) their interdependence produces an outcome that no…

The purpose of this study was to evaluate the degree of classification quality in the basic latent class model when covariates are either included or are not included in the model. To accomplish this task, Monte Carlo simulations were conducted in which the results of models with and without a covariate were compared. Based on these simulations,…

Coursebooks have become the most prominent English learning materials, especially in formal education. Therefore, recursive evaluation should be conducted to adjust the coursebook based on the current needs and learning goals. Moreover, dynamic evaluation brings interaction or mediation with a genuine act of teaching to make the evaluation more…

Debates about appropriate, fair and effective ways of assessing research and researchers have raged through the scientific community for decades, recently mostly concerned with discussing the merits and limitations of metric-based, quantitative assessments versus peer review-based, qualitative alternatives. Ample attention has been paid to formal…

Youth in the U.S. face a mental health crisis--one that has steadily worsened over the past 10 years (Centers for Disease Control, 2023). Youth with disabilities may experience increased mental health risk compared to their peers without disabilities. Recent national surveys and systematic reviews reveal that mental health risk may be elevated for…

This classroom-based action research (CBAR) corroborated our belief in the valuable role rubrics play in a tertiary L2 writing context where English is the medium of instruction. The three-stage CBAR involved ongoing discussions between us, two writing teacher-researchers, as we adapted our teaching and assessment strategies to explore the…

Technology in education is purposely designed to help both educators and students in knowledge transfer and knowledge gain simultaneously. In many aspects, technology in education is supposed to prove that education can be delivered effectively and efficiently. However, there are cases in which technology in education can be frustrating and…

Remembering information about others is important but challenging in various social contexts. For instance, in long-term collaborative educational settings, students often need to choose peers for academic support. In different contexts, the selection process can depend on group awareness, i.e., the state of being informed about relevant social or…

Assessment policy internationally places significant importance on the use of assessment criteria across all subject areas. However, in order to ensure effective use of criteria, it is critical for teachers to develop an in-depth understanding of them. This paper reports on a study of a range of Australian Science teachers' views and uses of…

In this article we attempt to reconstruct the tacit and implicit notions of quality in the humanities. This reconstruction is based on a series of semi-structured qualitative interviews with 33 humanities scholars. Applying Max Weber's theory of authority, we argue the quality notions have two different sources--external and internal. External…

This paper presents a framework for utilizing Student Evaluations of Teaching (SET) in faculty evaluations. Recognizing the ongoing debate about the validity of SET as a measure of teaching effectiveness, the authors agree with scholars who propose viewing SET as a tool for gauging 'student perceptions of learning'. They present a method that…

Dynamic structural equation modeling (DSEM) is a useful technique for analyzing intensive longitudinal data. A challenge of applying DSEM is the missing data problem. The impact of missing data on DSEM, especially on widely applied DSEM such as the two-level vector autoregressive (VAR) cross-lagged models, however, is understudied. To fill the…

Propensity score matching and weighting methods are often used in observational effectiveness studies to reduce imbalance between treated and untreated groups on a set of potential confounders. However, much of the prior methodological literature on matching and weighting has yet to examine performance for scenarios with a majority of treated…

Surveys are typical for student evaluation of teaching (SET). Survey research consistently confirms the negative impacts of careless responses on research validity, including low data quality and invalid research inferences. SET literature seldom addresses if careless responses are present and how to improve. To improve evaluation practices and…

Prospective students and their families use college rankings to navigate their higher education options. Rising tuition and fees have made the college decision more fraught. Recently, the major college ranking providers have revised their methodologies to reflect costs and other considerations. These revisions raise important questions about the…