Outside of education, many academic disciplines developed and promulgated checklists to evaluate the quality of qualitative studies. This article used an embedded mixed methods approach in three stages: development of a conceptual framework reviewing 62 guidelines; a content analysis of key areas of the guidelines; and review of dissertations to…

In this article, we examine whether cross-national studies disclose enough information for independent researchers to evaluate the validity and reliability of the findings (evaluation transparency) or to perform a direct replication (replicability transparency). The first contribution is theoretical. We develop a heuristic theoretical model…

This study examines meta-analysis studies published in the field of educational sciences from 2010-2019, in journals indexed within the scope of the TÜBITAK ULAKBIM TR Directory. Of the 163 studies scanned, 26 meta-analysis studies that meet the inclusion criteria constitute the sample of this content analysis study. Within this research, a…

This report presents a review of the statistical practices of 30 journals representative of the second language field. A review of 150 articles showed a number of prevalent statistical violations including incomplete reporting of reliability, validity, non-significant results, effect sizes, and assumption checks as well as making inferences from…

This research study aims to evaluate the graduate theses and articles conducted on the concept of instructional leadership over the period between 2002 and 2017 in Turkey by means of methodological and statistical analysis techniques. In the study, which is configured by using the case study design as one of the qualitative research methods, the…

Student self-assessment is a central component of current conceptions of formative and classroom assessment. The research on self-assessment has focused on its efficacy in promoting both academic achievement and self-regulated learning, with little concern for issues of validity. Because reliability of testing is considered a sine qua non for the…

Staff members at Sesame Workshop asked us to conduct a meta-analysis of their proprietary evaluation research on the effects of viewing international versions of "Sesame Street." Given global crises in early childhood education, and given the wide reach of "Sesame Street," it was of considerable interest to us whether there…

The purpose of this study was to examine the quality of quantitative articles published in the "Journal of Counseling & Development." Quality concerns arose in regard to omissions of psychometric information of instruments, effect sizes, and statistical power. Type VI and II errors were found. Strengths included stated research…

A number of studies have used mindfulness-based interventions to influence the behavior of people with intellectual disabilities, to improve their quality of life, and to reduce challenging behavior. The present review critically evaluates 18 studies and assesses the clinical and academic impact of their findings. Strengths identified included…

This article reviews issues and findings from 13 research studies relative to cross-racial supervision. The research in this area indicates that a strong working alliance between the supervisor and student is more likely to happen when supervisors are culturally responsive and competent. However, in order to better appreciate the nature and scope…

A variety of methodological and statistical problems in the Roffe and Bryant study of the McCarthy Scales' profile reliability are pointed out. Alternative procedures and more efficacious use of the Roffe and Bryant data are suggested. (Author)

Research articles that applied quantitative techniques and were published in "Journal of Leisure Research" were examined for methodological adequacy. Suggestions to improve leisure research are offered. (DF)

Attempting to correct and amplify the portrayal of Stephen Crane in journalism history, this paper provides an analysis of relevant works in journalism and other disciplines in order to point out the weaknesses in the journalism historiography and to show how they apparently came about. Evidence is presented from the literature of journalism,…

The present article reviews the procedures that have been developed for measuring the reliability of human observers' judgments when making direct observations of behavior. These include the percentage of agreement, Cohen's Kappa, phi, and univariate and multivariate agreement measures that are based on quasi-equiprobability and quasi-independence…

The ability of individuals to make accurate judgments about others is examined and literature on this subject is reviewed. A wide variety of situational factors affects the appraisal of performance. It is generally accepted that the purpose of the appraisal influences the accuracy of the appraiser. The instrumentation, or tools, available to the…